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ABSTRACT 

The report deals with the design, development, 
evaluation "of a set of self- instructional lodules concerning 
preinstructiofial competencies for teachers of the hacdioapped. 
introductory chapter covers background inf oraa tion, general 
oblectives of the program, components of the modules^ and stages in 
the development of the modules (analysis, desigt, and evaluation); 
Suamarized in Chapter II are the salient foints of each of the 11 
nodules which involve competencies in the following areas: specifying 
behavioral objectives, task analysis, lesson planning through task 
analysis, concept analysis,, planning a concept lesson, instructional 
qaaes for handicapped children, choosing a curriculum package, . 
teacher-made reading materials, classroom charts for haneioapped 
children,^ classroom graphics for handicapfed- children, and preparing 
tutorial materials. Chapter III describes the , activities carried out 
in the design and production of the actual audio-visual lodules. A 
fourth chapter outlines the rationale and procedures Involved in the 
evaluation of the set of preinstructional competencies icoules as a 
total package. A final chapter discusses field-test results in -three 
areas: trainees' attainment of preinstructional competencies as 
measured by applied performance tests based on the objectives for 
each modjale; changes in trainees' attitudes toward the ccrtent 
individual modules, and changes in trainees' attitudes toiiard 
self-instructional format of the modules. .(SBH) 
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PREFACE, , 

This report „deals with the design, development -and evaluation of a 
set of SQlf-instructional modules concerning preinstructional competencies- 
for teachers of tfie handicappedo Tne project involved a total of 11 modules 
'dealing with task/and concept .^analyses, preparing a lesson plan, and / 
.designing instructional games, individualized reading materials, graphics, 
charts and tutoring matferiais» Most of the modules \in the project utilized 

a combination of /ilmstrips', audiotape* cassettes, and response booklets. 

t" ' ' . 

Analysis ^ 

A systematic procedure was used' for the' analysi-s, design, formative 

evaluation and fevision of each module, A basic needs analysis identified 

the instructional topic for the modules. Learner analysis identified the ^ 

Relevant characteristics of^teacher trainees who are likely to benefit from 

the use of the modules, A context analysis identified the resources and 

constraints in/the situation in which the modules are likely to be used. 

Task and concept analyses yielded the components of the instructional 

content. Specifications for th©^ niodules were drawn up on the basis ofi 

these analyses.* * . 

Development \ 



" Xhe actual design of the module began with the preparation of the 
response booklet which contained criterion items based, on the in^structional 

ectives. A script foj the audiotape and "a storyboard for the visuals 
were next created. The prototype materials were evaluated and edited 
by a panel of experts and suitably modified on the basis of ':heir feedback. 
Each module was then tried out on representative students litable 



/ 



modifications were made Dn the basis of their responses, remarks and reactions, 
Evaluation * 



A summative field evaluation involved a total package testing in tfwo 
field sites under- regular classroom conditions. Trainees* competencies in 
specific preinstructional skills were measured through the use of applied 
performance tests whicli. required a transfer of the competencies to real 
preinstructional tasks « Attitudes of the trainees toward individual competencies 
and toward self -instruction were also measured. Trainees' performances on the 
applied tests were evaluated at the two field sites by the local instructors. 
When instructor ratings were compared> a discrepancy was found between the 
performance of the trainees in these two field sites. .Possit)le explanations 
for this discrepancy included differences -between the two instructors and 
between the two groups" of learners-. There was a strong indication that 
the materials were not as independent of the instructor as earlier formative 
evaluation had suggested^ Results from the" attitude measurement were more 
consistent between the two sit^s and were generally positive. Modules 
dealing with the production of a specific instructional material (e,gp, 
tutoring materials) were generally perceived to be more interesting and- . 
useful^than those dealing with the underlying J:heory (e.g.^^^ncept analysis). 
Trainee attitudes Jtoward self-instruction showed a^g^neral positive shift 
as measured by a semantic differential scale^." Thus, the project has resulted 
in the production and validation of a set of modules involving those 
competencies which enablfe teachers of the handicapped to plan and pjbepare 
materials for individualizing instruction. 
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. CHAPTER 1 
INTMDUCT^ON ^ 



Teachers of the handicapped-^whether in special education or regular 
elementary classroonis--have considerable training and experience in inter- , 
active instruction . They are r^ady to* explaim, demonstrate, question, - . 
prompt, probe, aiiiL provide feedback to a group of learhers'^ in a face-to- 
face situation.' In contrast, tEey generally lack the preinstructional 
competencies of analyzing, prescribing, retrieving^ and designing inV 
structional materials-, and the ability to 'integrate them into a lesson plan 
which focuses on the' management of learning i-nstead of teaching! 



): , ./ . - . 

r ' ■ BACKGROUND ' _ 

^ Most teach-ers receive instruction on stating beha^oral objectives 

and lesson planning. They* are "aJ.so re"?[uired to undertake these activities 

in practicum situat*ions. flowever,^ m^ny teachers of the handicapped , ^ 

■. ■ , ' . > ^ 

perceive them to be "busywork" and of limited use in the classroom. This 

attitude is often due to a misundj^rstanding of the telationship tJetween 

\ ' ^1 ' 

different preinstructional activities and the actual interactive teaching 

of the lesson. A strong and systematically planned foundation for instruction 

can insure more individualized learning, thus increasing learning efficiency. 

There is an urgent need to provide teachers with an integrated! s€t of ^ 

preinstructional competentaes with sufficien€ face validity. 

Writing behavioral objectives acquires a new meaning and importance 

^%rhen preceded by a task analysis and succeeded by the selection or design c/r- 

suitable instructional materiafs. Us"eful 'and practical skills< in the* areas 

-of 'task a,nd. concept analyses, followed by^lessuns. planned on their basis 



are currently available. But,' there is a problem in providing them to 

k' ■ , ' - * 

teachers of the handicapped in a flexible format. Until recently, the 
only tfav teachers of handicapped learners could acquire these pre- 
instructional competencies was by enrolling in traditional id^ture and 
textbook courses . The Effectiveness of this time-honored approach has still 
to be proven. -* . • , ' 

TTte, field, of special educat^ion leads other areas in the development 

' i . „ 

of turri^ulum packages Ce.g. , Pfau, 1972; Goods^in, 1:974). TTiese . \, ^ 

materials have v^rv often been prepared through foundation and federal 

■ * . ' ' ' ! ' ^ ' 

'grants, reflecting the best in systematic development, attractive and ^ * ^ 

functional packaging, fiexil?le and integrated, Usability and innovative 

content. Although widely disseminated,, they have Rot been as widely . 

adopted. The integration/of * these instructional packages into classroom . , 

instruction requires new role for" the teacher, and a new set of competencies. 

Under the current system, theser roles and competencies are acquired only 

afffer a teacher chooses(/torijse, a curriculum package (or is told to use it 

t V ^ ^ 

\y the administration]. Teacher Ls^manuals of ^workshops provided by package ^ 

developer*^ traivn the teacher in the bse of tf^at particular' package. An obviqus 

need in th^is area is ^ general introduction to curriculum .packages . In 

addition to providing a ^et of preinstructional competencies to the teacher, 

such an :t introduction can clarify .Various doubts and misconceptions that 

♦he/she may have. Thus,^ bothV^ihe rate' of adopt-^n'and effective us;e ^ th«se 

packages can be increasedo . ' ^ , 

However extensive such curriculum packages may be, there still, ^xist 

m^ny gaps in the cuppiculum'' fpr'tvhich there are no prepackaged materials. 

In these areas, the teacher is tempted to lecture and *'teach" in the interactive. 
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sense of the term, even though .it^irtay not be .appropriate « Some' teachers do 
• • " ■ * " ' , ■ ■\ ■ . i "* • ■ * 

have production capabilities, but vory_''few Ijave instrucitibnal .development skills 

ThiS;;ls unfortunate ^incp' many jthe few existing teacher-made instructional l-^ 

' uhi€srtmvle produced encouraging t^suits. ^ The teacher prpbably 'Rnows - . , P.: 

' mo^rp|about^'the requirements of the children in his/her class ro6ln than • 

even a professional t^am of instructional developers. The teacher can* 

retain control over th^e content when.he/she designs instructional packages. 

in such forms -as simple games or classroom., charts ♦ jjfitpractive instruction - 

is transient; a t^eacheof/'faces critical pfoblems Wfxen confronted with. the . t> 

. below-av^rage chilfd who .requires remedial instruction, or the above- 

average student-. who reqi^iires '^orUje a/'enrichment" to keep him usefully. ' • 

occupied, or the, absentee who has., to catch up with his peers. Rather 

J^TJf.than spend time in tutoring e^h of these types of chLldren, the classroom^^ 

which has a library of flexible^ instructional units that can be used 

Efficiently provides^ increased systematic individualized instruction to 

4;. each o£ these "special" childj^en. But these units first have to b^ 

, designed, and there remains very little systematic training available for 

the classrroom'>teacher at the present timeo 

■ * ^ . ■ ■ 

Ir^^'^xi^^^i the problemsj and needs of this project resulted from 
excess emphasis--often implicit an (1 unnoticed- -on interactive^teaching. 
While the teacher does receive some training in*becon)ing a planner and 
manager of in'structipn, this is usuaHy done-^'in a piecemeal fashion. Both, 
preservic^ and inservice teachers n^ged a systematic approach to the* pre- 
instructional competencies^f 1) analyzing instructional tasks or concepts, 
2) derivj^il^ a set of objectives for the individual child, 3) systematic 
lesson planning, 4) selecting and planning the use of curriculum packages. 
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and 5) utilizing analytic and planninig skills to design materials which, 
meet the objectives set for every one of their handicapped learners. 
General Objectives for the Program^ ' . 

' / The mediated program was designed to deal with the improvement of 
. preinstructional' competencies of teachers of the" handicapped both in 
, .special education and regular elementary, classrooms. Upon completion of 
the following set of modules, teachers should be able to demonstrate these 
competencies: ; ' • . ' , ^ , ^ .. . 

Specify bghavior objective^ o State- a comprehensive set of behavioral 
objectives for a lesson of his/her o\m choice. 

Perform a concept analysis . Select a fundamental concept in the lesson 
taught, identify the critical/^nd variable attributes of the concept, and 
collect or create a set of suitable examples and nonexamp^s for teaching 
- and testing. - . . - 

Perform a task analysis . Analyze a self-selected lesson topic irito 
« a hierarchical set of necessary and ^fficient subtasks. 

Plan a lesson using task analysis . Prepare a lesson plan based' on the 
analysis of a main tasko 

Plan a lesson using concept analysis . Prepare a lesson for teaching 
a concept of his/her own choice. The lesson plan should include the sequence 
of' steps, entry tests and posttests, the nature of examples to be u$ed in 
different stages of teaching and^^.testing, and specification of learner 
responses. 

Choose a curriculum package . Identify the seven critical attributes of 
all good patkages, state their advantages and disadvantages, and apply prin- 

ciples of selection in choosing a curriculum package, 

* N — ^ ' . 

V Design instructional g a mes for handicapped learners . Modify instruc- 
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tional games for use with handicapped children in his/her classroom and. 
adapt existing gamps for the handicapped to present new topics. 

Prepare teacher-made reading materials fdr his/her handicapped leamei:^. 
Plan and write materials matched to the reading achievement level and 
interests handicapped children « 

V " Prepstre classroom ctyrts for handicapped children . Develop a classroom^ 
chart of his/her own, taking into consideration the nature of tke^learners, .\ 
the content'^ to be taught, the medium to be used, the timing of the presen- • 
tation, and the chart's intended purpose, 

■ Produce classroom graphics iCor handicapped children, , . Dels.ign his/her 

i ■ ^ ■ ...... 

own visual materials to facilitate a handicapped learner's attainment of 
(a) prespecified instructional objective (s) « 

Design tutoring materials ^ Prepare, try out, and revise a specific type 
of tutoring kit which includes a set of flashcards for the learner and a p.er- 
formance aid for the tutor « ^ 
Components of the modules 

With the exception of two modules. Specifying Behavioral Objectives 
and Choose a Curriculum Package , all the modules in the series are made up 
of three components: a response book, an audiocassette^, and a filmstrip» 
All three components are integrated in a single instructional package. 

The audiocassette serves as the coordinating element for the module. 
This audiotape is also the majqr source of instruction and informationo 
Through realistic . storylines , dialogues, and narration, the audiotape heightens 
the trainee's interest and motivation* Instruction on how to use the other 
components is also, provided by this audiocassette tape. ^ 

' The filmstrip is carefully coordinated with the audiotape through elect;rqn 



,synchronization (although audible advance tones are also provided on the 

tap^^^r those without automatic synchronization capabilities). The > 

/ • ' 

/'Visuals permit the use of such graphic devices as live photograph^, 

illustrations, captions, charts, and proshots to supplement, clarify, 

' ' '•' J- 

enrich, and focus attention on tlie message presented through the audiotape* 

The response book is the most important component for the trainee, as | 
it may be retained permanently after completing the moduleo This book requires 
the trainee to complete various exercises while progressing through the module. 
Such active involvement on the part of the learner is expected to provide 
a blueprint for classroom application of whatever skills are acquired. The 
response book also contains the objectives for the module, flowcharts, Qheck- 
lists, tabled, references, and other materials which the trainee maV need to 
refer to long after working through the module. ' • 

„ A number of technical standards were established for the instructional 
design and production 9f the mediated series^ The need for these standards 
will become obvious when the results of the context analysis for the use of 
the modules is revealed. The technical standards that were established in- 
cluded : 

1. Each module had to be tested on representative members of the 
target population under replicable conditions and its effectiveness had to be 
clearly demonstrated. " , 

. 2. Each module had to be sufficiently transportable to permit' effective 
use by trainees without the direct support of an instructor. 

3. Each module had to be integratable with all other modules in order 
to permit use as a total program. 

4. Each module had to be- competency-based and include specific behavioral 
objectives and criterion-referenced test items. ' 

16 ' . 



5, Each module had to meet technical standards for acceptable media 
•production quality. , 

6. Each module had to possess sufficient face validity to satisfy 
expert reviewers regarding its appropriateness, effectiveness, and feasibility 
for teachers of the handicapped,. 

A MODULE FOR THE DEVELOPMENT OF THE MODULES 

Selection of the particular media combination descri' lier for 

the modules in this series was not without a strong ratio^ Stoloyitch 
(1975), in a careful review of media and media selection les, found 

that media attributes cliister into four major categories design of 

instructional materials: learner, task, production, and ^ .bution. By 
comparing a wide variety of media he derived an optimal ccrr:i tion ^for 
obtaining the maximum number of media attributes for the i.^r zosto As 
Table 1 shows, the combination of print, audiotape, and siide or filmstrip 
contains all the attributes of all the other media except for three-dimen- 
sionality and motion^ Hence, where instruction does not require either 
physical manipulation or motion, this media combination is the most cost 
effectiveo The series of modules met the necessary : condition:: for utiliz-ing 
this media corabinationo Production of a response book, audic ::assette, and 
filmstrip for each-module required skills which were readily available to 
the project team , and offered the flexible, self-contained training format 
that was sought/ 
4-'D model 

Xhiagarajan, Semmel 5 SemAiel (1974) have evolved a systematic instructional 
development model, the 4-D model, which offers general guidelines for producing 
training materials for teachers of the handicapped. This tested model, however, 
has proved to be too ^ » ' 
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Table I 



Media/Media Attributes 



Media 



Si 



-^3 
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o 

»— 

. CO 

»— 



Audio 
Visual 
Motion * 
Color 

3-Dimcns1onal i ty 
Real ism 



Response Acceptance 

Feedback 

Audio 

Visual s 

Self^racing 

Random Access ' 



WTtability 
Transport-abl 1 i ty 
Simplicity 
Low Cost 
Short TinK? 
Requirctnont 



Editability ' 
Self-Contained 
Schedu ] ing 

Mexibillty 
General 

AvailabilUy 
^a^e of Use 
Low^Cost 

Qu-Ick Set-up Time 
Np Special ' 
'E'liviror^ht 
Qreuping FJexiibiUty 
C<^pactness Han^ 
- $^orage.\V ^ 



X 
X 



/ 

'/ 

X 

/ 

X 



X 

/ 

X 
X 

/ 



_L 



^/s usually present in the r:^ed^L^n 
e»/Can be obtained, but i-s not a 
usual attribute of the modium 
Is usually not associated with 
the mediun 
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general whep applied to the development^ of modules in which there is a 
prespecified media combination. Stolovitch (1975) has made a number o^. 
adaptations to the model and has tested two products with student: teachers. 
The success. of this adapted model permitted it to becofne the Primary source 
document for the development of aJjl the modules in the prei.. ructional 
series. This adapted model, shown in Y i^ure 1.1, is describee below, \^ 
Analysis Stage t 

This stage is concerned with identifying the different factors which 



influence the design and development of the instructional modules. During 
this stage, a systematic needs analysis /is carried out to find|the mq^t o 
appropriate topic fpr each moduleo -Based or- this topic, learner, context, 
^task and concept analyses are conducted to derive a set of instructional 
requirements consistent with the needs, environmental ^factors, and learner 
characteristics, and a set of behavioral objective's based on the structure 
of the tasks and concepts « . 

Needs analysis . The production of an audio-visual training module 
should be preceded by a systematic analysis so' that real problems are 
identified and arranged in ian ortJer of priorityo During this step, symptofns 
of the problem^ are identified to clarify in specific terms t characteristics 
and effects. As the problem is diagnosed, underlying causes are uncovered, 
yielding alternative solutions . / 

Learner analysis . This analysis examines the target audience. 
Audio-visual t:^aining modules which are produced by. a .developer without' 
careful consideration of the learner's characteristics are usually ineffective 
(Gordon, 1970). Content, presentation- form, language 
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1. NEEDS 
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INSTRUC 



'.Y 
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OF 
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'.CONTEXT. 
MALYSIS 



U 



' 5. TASK, 
'ANALYSIS 



6. CONCEPT 
ANALYSIS 



V.JPE-CIFICATIOK OF - 
I^NSTRUCTIONAL OBJECTI VES 



9.I0ENTIFICA" ION 
EXISTING HAT-RIA 



DIA & FORMAT 

.LHCTION ' ' 



ToEst 



8.(;0NSTRUCTI0N OF 
CRITERION 'TEST 
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ODUC^,ON 

OTOTYPE 
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13. EXPERT 
APPRAISAL 



DE • EL'OPHrNTAL 
TISTING 



15. iMATIVE EVALUATION: 
.1 DATION TESTING 



lu. LEGAL CLEARANCES 



17. FINAL PACKAGING 



18. DISSEMINATION 



19. FACILITATION' 
OF ADOPTION 



RE.VISION 



EVALU/^ION 



Fig.l Adapted 4-D Model (Stolovitch, 1975) 
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knowle{ 



iust all vary with the' type of learner ujxiilzing the 
i: .lysis permits identification of thoJ^e^ Earner ch;r' ^ct^risti s 
interafct with^the design of instruction. In thi ^.tep, 
justruct: questionnaires^ to testVthye learner 's, entry irvel 
£i'nd^ experience o Sliitlible scales are als6 administered 



to t( 

format 

unfle 

vari 
cond 
thei 

sun .iudii 
ibility £9; 



rner's' attitudes toward the conteat and the 



^dio~vi 



su: 



i 



:rvoy to determirie language/ stylfe ;and media pref eijences -is ' also 

The effectiveness of an audio-visual rrainin^ rn^^' 

'.io in wl i-ch it is implemented. An ana^lysis 1 

> >^ . 

In what situations ,(e.g« , worKsRops or collegr 1 
> This analysis includes examinq^tion of pi 



iab or utilization in order to ensurp^maximujn 



module 



^ ^^ifica'cion of i: strtictiol^a'L requirementS o The needs an^ysis 

uncovcjfs a priority in the field that can be dealt ^with by using an audio- 

visuai^^training module. The learnei analysis examines the taTg'et aud: ce. 
The context analysis establishes the situatifeins in which the module co 
be used. From these analyses, specifications for th^ module are made. Thesa 
specifications state what' must be done, for whom, and using what approach. 
These* specifications also identify time, cost, and res<3arce constraintSo 

Task analysis . Here, the instructional topic .is analyzed iif terms of 
the information, skills and knowledge that the learner must acquire. Each major 
element of the content isbroken into its component parts. .The main /task is 
analyzed into s^btasks, each of which is further analyzed until the trainees' 
entry level is reached. Each sul^task is scrutinized, eliminating the isuper- . 
fluoiis and trivial • ^ " , . • 
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Concept analysis . In addition tb the s! and s-:r ; je 

acquired by the trainees , there are a number fi :ndaine-:t-.-l . -wh - uh 

must be mast-.^ed. The instructional content ^: sprual 

raineworks. ^ concept, is isolated and it. 

re J.dentif i xamples and -nonexaraples of 

i' -g and testing . < ' 

cV a oj \nstruc ':ional objecti n 

or ^ foundation upon ms:. r ,|^zr ■ :l 

■ spc. ■) -nd cpncep^t analyses :*c/id( \c mg ::^:-ae 

i jtionai objejptives. These ob j c Ivl in I 

' >tate clearly and' unambiguously whi- . tl l^r- ove, 

ci — u. lO audio-visual traiiiing module. iiese ol.^ fc 

■ « 

the ..raine . t they "tan expect from the module i*o .-^jv 

oj j ectives.,f om Jie base for the design of the ^ .ii: 3"u*"-:cri 

6> 

ced tests. 

If 

i St. ^ 



he s jec, f ication of instructional'requirer^.ents id c es sigr.als 

tart of :he Design stage in the revrsed -:-D mod Th: . sv :ige involves 
. le steps of media allocation, preparing initial bli .:rints for :he booklet, 
audiocassatte and filmstrip components, making prel: nary revisions, pro- 
ducing each, component , and assembling the entire auco-visual ti;aiTtlng module 
in its prototype foni/: Specific details of each step in this stage are given 
below. - / 

Media allocation . In the revised 4-D model^the edia components are 

c 

preselected. The audio-visual training module consi: : three major com- 
ponents: .a printed booklet, an audiocassette and i.- trip. Tl nstruc- 
tional content is systematically distributed to th a: ropriate cc /ient._ 
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re develope 


ach objoctp/r 


•J > 
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own respo 
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« 

' . Af :er the item^' in trie ;spon: 
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:equencedj. s 


evaluated by different expert:.. Su 


•matter exp^ 


examine t. .sponse 


book for accuracy and releva ::e. 1 


T: rr-^ :ztional dev . 


i:/::uent exper \eck 


to. see whether the objective: ai*e 


or:' tly and logi 


ca^:^ formul;i: ind whether 


the criterion items are v illi , A 


.iu< i^e editor re 


vie ;s the apprcr*" lateness • 


of the language and corrects: i y or 


ror . From these 


evaluations, a revised 



response book emerges. ^ - 

Script . The script for the audiotape, including the. cast of' characters, 

y 

narrative, dialogue, and music, is the main teaching component of the module. 

^ y \ ' ' 

A storyline^ith e'asily identifiable character^, is created for the script 
which teaches toward each criterion item of the response book.^ The narration 
also provides explanations and direction for other learning activities. ^ 

As with the response book, the script goes through repeated ^valuation. 
Subject-matter experts examine it to ensure, that' the message is carried 
effectively to the learners. Principles, generalizations, and illustrative exampl 



Tecoivey^rt xular Scrutiny. In additioh, ii^structional development experts • 
study the Script fdr . consistency Vith the obj ectives / production expert^ : ' 
.vePifyVthef : -ript. for audio quality, and language editors tighten ,tlie language. 

\ / . ' - . r - ^, / ' , 

As the scrir approaches recording , narrators review .the script for word 
changes,, empri^jisis and timing. Tliese evaluations .result in a .prptptype ' 5cript - 
ready for recording. ' . * 1 ^ ^ 

• Visual, storyboard . "^Jlist as the ^script evolves from' the criterion items 

in the response book, th^ visqal st<rryboard develops as tlie script is written.' 
The visual companent otHthe audio-visual training inodule serVos three functions 

r) ,It motivates the learner and maintains his interest level. 

2) It provides visual .messages which enham:e the audio portion. 



The visual storyboard is designed parallel to the script, sometimes 



3) It acts .as a focuser of attention.^ 



'following from the words *>f the script, sometimes generating 'narrative. 
The visuals in the storyboard are divided into thr^e major categories: 
1) Photogcaphs of tlie cluiracters Iti action. 
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2) .Photographs of materials or objects. --^^ 

3) Graphics including artwork and lettering. 

Once the visual storyboard^is complete, rough sketches and trt§ script are 
submitted for evaluation to production experts. 

Prototype production . When all three major components of the audio- 
visual training module have been sufficiently revised^they are produced in 
) % * 

a prototype form. The response book is typed in, its final .form. The sci^pt 

^^^^ 

is duplicated in the format required for audio production and distributed 
to narrators. Rehearsals are held for the^^audio taping session. The script 
Jis recorded and^edited. The visuals are produced in a serjLes of sessions. 



. ;Live shots are phgtographed location and §ra]phics^ are .photographed on 

a copy^*stana. The end" result is a prototype module consisting of "ah 
'^audiotape, a- series of slides and a response bobk^ ^ "T^""" ' 

Assembly . J When all corapoiTents have heen produced, assembly takes 
place. At this sta'ge, the final selection of -visuals vts made. Tihe response 

. , \ ^\ ^ ■ . , ; 

book is duplicated .and bouncj, and the audiocassett e is synchronized witH the 
' slides. The entire> package is checked fox internal inconsistency , errors ^^ 
and omissions. Duplicate copies of all components ; are made, and the prototype 
module i<s then submitted for developmental testing. 

Developmental testing. Once the prototype audio-visual training module ^ ^ 

I ^ - , " ' i " ' 

is assembled, it is tested on individuals and groups from the target popu- - 

.■ , ~ ' . ^ 

lation. These learners are obs'erved and tested both during and after completing 
the mbdule. The aim at .this stage is not to see how well the learner^ have 
learned, bjut to identify thoi:e parts which they fiiid difficult, irrelevant, 
and confusing. Testing sessions of this nature with indiv^iduals or small 
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groups provide extreinelv valuable feedback for final revisions. 

I , ' 

Expert 'appraisal . At the same time that developmental testing is' being 
conducted^, experts from the subject-matter area arid instructional technology 
are tasked to review the prototype materials. Their appraisal is focused 
through various checklists and their comments are collected for future 
revision. * - r ^ 

• ■ "i 

Revision . As feedback data from developmental testing and e^pfert 
appraisal come in, revisions ^are made in the module. The cycle of testing 

■% ' 

and revision is repeated until learner [performance and expert comments 
appear consist ent;ly satisfactory. • The^'total package is now prepared for 
, final production. * • ^ / ''V 



Final production . TheAfinal audio-visual training mbdule inco:^orates 
ali the rpvisigns :derived from .the developmental testing dnd expert appraise!, 
The response book is' typeset and printed in'its :^nal form. The slides 
are converted-'' to a filmstrip. The audiocassette is edited and duplicated. 
The total module is assenvbled.^aad jnadc ready for. the field, 
fivalua*tibn Stage ^ ^ ' • ' , ^ ^ ) 



' ^ After- the final pi-odi^/tion* and assembly, the aud^o-visual training < / 
module i's subjected to -,an extensive summative. evaluati9n . ^ The evaluation, 
design dependent on the content 'of the modules--is the module a single 

shot material or does it need testing' as part of a larger series? Specific 

p "... 

evaluation desigijs, therefore, flow from th| particular requirements of the 
overall object ive -for each module, » 
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' "* — 
' CHAPTER 2 • 

. #v — BASIC ANALYSES ' - 

Needs Ahalysis * * • \. i,. 

The introductory pages of this chapter provide the basic faftonale 
fqr each module in the series on preinstructional compe'tencies for .>< 
teachers of the handicapped. Thilg rationale was developed on the basis 
' of discussions with teaxzhers of the handicapped, consulting teachers, school 

. administrators^ special education teacher trainers, and pre-service special 
, edu^tidti teacher trairfees. Th'e following are^ summaries of the salient 

point|:^pji^ich emerged from an in-depth needs ' analysis of -each module. ;> C/ 

Module I: Specifying Behavioral Objectives W 

1. The behavioral objectives jnovement has'^an empirical base that dembristrates 
the effectiveness of using behavioral 'pbjectivets in education and training^ 
'2. Mifny states are legislating that teachers must designate specific 
individualized behavioral objectives for their handicapped learners 
Ce,g*, P.L. 198, Michigan] . ^ 
3. Behavioral objectives form t+ie base for criterion-referenced evatuation 
(Mager, 1973), which is the 'mos^^ appropriate techniqug for diagnostic 
^evaluation of handicapped learners. . 

Behavioral objectives can formM:he basis for the selection of suitable 
instructional material^ for haijdicapped learners (Rosen, 1975). 

5, Behavioral objectives can form the basis for the design of aViy type of 
teacher-developed instructional materials. 

6, Beha^^oral objectives form the basis for designing a wide variety of 
appropriate classroom Strategies and learner activities for handicsLpped 
childreh. - ' i 



27 



18 

7. Behavioral objectives enable meaningful communication with parents of 
handicapp.ed children concerning th^^progress of their children. Teachers 
can describe in demonstrable terms precisely what competencies children 

have acquired. 

V 

8. Behavioral objectives permit the teacher to individualize instruction 
according to ^the needs of each child. By varying specified conditions and 
.standards, behavioral objectives can be directly tailored to individual children. 

9. Behavioral objectives permit the teachers to communicate with one another 
and share their ideas concerning instructional strategies and information 
for individual students. The concreteness of the behavioral objectives 
offers teachers tangible strategies and meaningful results as a common 
grouhd for discussion. ; 

10. Behavioral objectives form a logical progression and sequencing of 
learning activities for handicapped youngsters and thereby provide continuity 
as the child proceeds: from class to class. Since behavioral objectives are 
stilted at a global level and then broken into smaller enabling objectives, 
all the various prerequisite activities form a coherent set leading to the 
attainment of some major objective. These major objectives are also sub- 
ordinate to greater objectives which may require several years for attainment. 

11. Behavioral objectives provide convenient units for planning a lesson in 
the special education curriculum, r 

12. Through the use of behavioral objectives, teachers can provide a mastery 
learning environment which eliminates the competitive atmosphere of 
normative evaluation. 

Module II: Task Analysis 

1, Task analysis enables a teacher to derive a rational set of behavioral 
objectives rather than selecting unrelated sets of items. 
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2. Task analysis permits the teacher to analyze a main task into all 
necipssary and sufficient subtasks, thus minimizing the' number of super- 
fluous and unnecessary tasks which might be taught to the handicapped 
learner, 

?- 

3. Task analysis organizes the content of learning into a hierarchial 
structure. This enables the'te^cher to identify the optimal instructional 
sequence,' 

4, A task analysis provides the basis for diagnostic testing and placement 

of individual students in an instructional continuum, ' ^ 

5, Task ^analysis allows teachers to better discriminate between learners 
who have the prerequisite skills for a given lesson and those who have not 
yet acquired these skills. 

6. Task analysis enables the teacher to bireak down a major task into a 
number of small steps that are easier for a handicapped child to manage, 

7, Task analysis offers a means for cooperative analysis of an instructional 
task' so that several teachers can share their expertise in developing a 
u^seable hierarchy of subtasks in an area of 4:onmion concern. 

8. A task analysis can be converted^into a checklist for evaluating the 
perforjaance of a child. 

9, Task analysis forms the basis for tracking the progress of a child as 

V/' ■ ' 1 

h#^?proceeds toward mastery of a complex main task. 
^10, .,Task analysis forms the basis for the systematic planning of lessons. 
• Module III: Lesson Planning Through Task Analysis 

1, Usjing ta^k analysis, systematic lesson plans can be derived, 

2, This lesson-planning technique^ ensures an effective sequence of objectives. 
The hierarchy of the task is clearly identified before hand, thus permitting 
the lesson sequence to be logically and appropriately sti^ctured. 
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3. Lesson planning through task analysis ensures that appropriate 
materials are selected for each phase of the lesson. 

4. Lesson planning through task analysis suggests suitable teacher 
activities which are ^t^evant to the structure of the task. 

5. Lesson planning through task analysis enables the teacher to establish 
leamet activities which are meaningfully related to the instructional 
task, ' ■ / ' > 

6. Lesson planning through task analysis provides^^-togical and functional 
test items to evaluate^ and diagnose the performance of handicapped learners, 
Hence, the built-in test items force monitoring to take place during every 
lesson. 

7. Lesson planning through tagk analysis makes use of the effort and 
thought which the teacher puts into the task analyses. 

8. Lesson plans based on task analysis are reusable. 

9. Lesson plans derived from task analyses communicate both a hierarchy 
of subtasks and their, interrelationships .i This permits them to be 
exchanged among teachers, facilitating planning for all teachers. 

10. Lesson plans derived from task analysis can be stored ^and built up 
over a period of years. 

11. Lesson planning through task analysis provides plans which can be 
used with parents for helping their handicapped children. 

12. The specifications in a lesson plan derived froi^task analyses 
demonstrates to parents, to peers, and to administrators the function 
of each activity and material that a teacher uses. 

13. Lesson planning gained from task analysis can readily be converted 
into self-contained mediated materials. 
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14, I^esson plans thus derived are so systematically linked that they ' 

^ enable continuity to take place when a teacher is absent or when ^a pupil i 
moves to another class, 

15, Lesson planninrg through task j analysis provides a consistent format 
for all lessons in the classroom, and thus enables the. handicapped learner 
to focus on the content rather than the format of a new lesson, 

16, Lesson planning through task analysis, as a format for preparing 
lessons, matches strategies for concept lesson planning. 

Module IV: Concept Analysis 

1. Handicapped children lack a solid base of fundamental concepts which 
impedes their learning. Therefore, effective teaching of concepts is of 
prime importance, • ' 

2. Concept analysis techniques shift the teacher's focus from verbal - * 
definitions and rote learning to nonverbal discrimination and generalization 
skills. ; ' 

3. Studies indicate (e.g., Zeaman § House, 1963] that the acquisition of 
concepts is primarily a function of stimulus presentation. Concept analysis ♦ 
suggests the necessary set of stimulus materials to be presented, y 

4. The use of conveniently available examples often results in stereotyped 
understanding and the generaliiiation of concepts. To eliminate this 
possibility, systematic concept analysis ensures organized presentation 

of a rational set of objectives. ^ / 

5. Systematic concept analysis enables the teacher to identify a divergent 
set of examples for strengthening the ability of\the handicapped child to - 
generalize , ' • ' 
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6. Systematic concept analysis permits the teacher identify matched 

sets of positive-negative examples, focusii^g the attention of the 

i 

handicapped child on the critical attributes of a concept.. 

7. Systematic concept analysis provides ROl^el examples and nonexamples 
for diagnostic testing of the child's attainment of a concept. 

8. Concept .analysis provides an instructional sequence for teachers, 
beginning with clear examples and^ concluding with close-in nonexamples, 
to ensure maximim general ir.ation and discrimination of a Concept by 
handicapped learners. ' 

9. Concept analysis translates a number of experimental findings .into a 
set of practical procedures for use by the classroom tea'cher. 

10. Concept analysis provides a base for systematic planning of' lessons 
involving concept acquisition. 

11. Concept analysis identifies the prerequisit-e concepts^a child must 
already possess in order to acquire a new one. 

Module V: Planning a- Concept Lesson 

l^^Lesson planning through concept analysis provides a logical sequence 
for hejpiit^ handicapped children acquire fundamental concepts that are 
ess^tial for further learning. 

2. The emphasis in lesson planning through concept analysis is on 
meaningful student participation. This ensures more learning. 

3. Thiis type of lesson-planning pi'oce^itire utilizes built-in evaluation 
to repeatedly check handicapped le^ners ' attainment of a concept, 

4. The concept lesson plan i;sr based on systenatic concept analysts that 
the teacher carries out an^ enables him/her to translate an analysis into 
a plan of action.^' 
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5, Lesson planning* through concept analysis incorporates logical sets of 

V - ■ . ' 

examples and nonexamples to fntroduce, prompt, and strengthen the mastery 
of a concept, • ] ^ * 

6» Lesson planning through concept analysis requires the teacher to devise 
appropriate learner activities which are relevant to the task of mastering 
a given concept • 

7» Test items yised in this tjppe of lesson plan help the teacher diagnose 
areas of misconception by the student, V . 

^ ■ V . - 

8. The concept lesson-pldfcning prpcedure has built-in decision points 
which indicate the need for remedial instruction or for more advanced ^ 
learning activities,. 

9. Lesson plans thus constructed can be reused and refined over a period 

' " , ' . * ' ■ ^ ' ' \ ^ 

of years , - 

10. Lesson planning derived from concept analysis can be shared among 
teachers, 

11. Lesson planning through concept analysis provides continuity in a 
teacher's absence or when the child jnoves on to another class, 

12. Lesson planning derived from concept analysis offers a JDeans of com- 
municating, in precise terms, the rationale for^each activity and material 
employed by the teacher, 

13. A lesson plan derived from a concept analysis forms the basis for a 
self-contained instructional material, 

14/ Lesson planning through concept analysis provides a consistent lesson^ 
format for handicapped children in mastering new concepts, 

15. Lesson planning through concept analysis harmonizes with other systematic 
lesson planning activities, such as lesson planning through task analysis. 
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Module VI: Instructional Games for Handicapped -Children 

— ^ 

1. In^tijjctipnal gaines make many abstract concepts more concrete for 
handicapped children, 

2. Converting the instructional 'topic into a game provides many insights 
to the teacher. - j . . 

3r Games focus and sustain the attention of handicapped children. 

4. Games provide repeated 'practice on fundamental skills in a pleasant 
fashion. - ^ ,1 

5. GaJies provide opportunities for children to acquire social skills. 

I i r ~ - - 

6. Instructional games provide immediate reinfor<:emetit for the mastery 

of instructional objectives. ' . ' 



7. GSnes enable children to learn from\»each other in a collaborative 
fashion, * \ 

8. The teacher can manipulate the chance/skill ratio of games in order 

to provide requal chances of success for children at different ability levels. 

9. Instructional games can be shared with parents, enablin^them to 
reioforce instructional concepts at home without any specialized training, 

10. Familiarity with game design principles enables the teacher to use 
commercial games more. ef:tectively with the slow learners, ^ 

11. Teachers can modify and ^dapt existing games for use with h^dicapped^ 
children. These modifications produce more effective learning than the 
original versions which are frequently designed for use with '^normal" 
children. ^ ' , . 

12. Many areas in the curriculum for the handicapped^ lend themselves to 
t active participation on the part of learners. Instructional games offer 

a means of channeling that activity. ^ 
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Moduli VII: Choosing a Curriculup Package 



1. Curriculum packages are systematically developed using generous resources 
beyond the reach of ordinary publishers. They represent the best in coi^ent 
and instructional Strategies. 

2. Curricufum packages are f ield-tealted and validated with handicapped 
learners. They are accountable for their success. 

3. Curriculum packages have specific behavioral objectives and can be 
easily integrated intoNthe classroom for the handicapped. 

4. By removing the concern about what to teach, curriculum packages enable 
the teacher to concentrate on how to teach. \ 

5. Curriculum packages structure teacher and learner activities over an 
extended period of time and thus simplify planning and preparation. 

6. Curriculum packages are systemaftically organized to suit a wide variety 
of individual differences among handicapped learners. 

I? 

7. Curriculum packages have built-in ^aTuation and diagrfbstic instrximents 
for prescribing suitable remedial and enrichment activities, 

8. Curriculum packages provide structure for paraprof essional and volunteer 
activities in the classroom for handicapped children, 

9. Curriculum packages are attractively packaged and learner-tested for a 
high level of motivation, 

10. The content of curriculum packages are extremely adequate, valid, and 
up-to-date, since they draw upon the resources of top authorities, 

11. Curriculum package activities are designed on the basis of sound 
psychological principles verified by research, 

yi. Curriculum packages employ a wider variety of instructional media in 
the presentation of their content to children with different stimulus needs. 
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Module vill; Teacher-mad^ reading materials \^ . 

!• Teacher-mWe reading materials provide m&re personally meaningful, 

> 

'instruction in reading to handicapped children. 

2. Teacher-made reading materials which are tailor-made to the specific 
levels and intei^ests of, individual children provide opportunities for 
sustained success. ^ ^ 

3. More relevant ^content in teacher-made reading materials improves 
unddystanding andlfnterest on the part o) handicapped learners. . 

4. Teacher-made reading materials provide opportunities for handicapped 
children to become actively involved in planning^ writing, and producing 
reading materials.* s.^^ ' ^ 

5. ^'eadher-made reading materials increase^leamer motivation; this 
enthusiasm transfers to other reading materials. 

6. Teacher-madel reading materials provide the maximuiirtopportunity to 
adapt vocabulai^A sentence structure and level of language to the capacities 
of the individual/ children, • ' 

.1 

7. Teacher-made stories can incorporate the repetition needed by ^ 
handicapped learners. « 

8. Teacher-made reading materials provide reading passages on topics for 
which commercial materials are either unavailable or* inappropria^. 

9. Teacher-made reading m^aterials are inexpensive to broduce in comparison 
with their .impact on Handicapped learners. v 

10. Teacher-made reading materials can be shared with parents and 



volunteers for continued reinforcement of reading activities. 

11. Teacher-made reading materials expand the resources available for 

c 

reading, / 



12. Teacherrmade reading materials provide the teach A* with insights into 
the teaching of readiTig and the use of controlled vocabulary. 

13. Tbachers who create their own reading materials become more efficient 
lisers of basal texts and readers. ^ ^ j 
Module IX; Classry)m Charts for Handicapped Children ' >^ • j 

1. Classroom charts provide a proven technique for stimulating the interest, 
of handicapped learners in a wide variety of curricular ateas. / ' 

2. Classroom charts provide a focus for discussion among handicapped 
learners and thus increase their fluency and expressive skills. 

3. The use of classroom charts to proifide appropriate reading experience 
is a validated technique in teaching reading to slow learners. 

4. The use of classroom charts elicits student comments and thus encoura^ge? 
them to participate ia the teaching-learning proce^. 

5. Very often handicapped children need repeated reviews. Suitable classroom 

charts enable the teacher to accomplish this objective. . ^ 

■• ■ « ' 

is. ^ Classroom charts pTovide visual cues for student participation and 

discussion during^>class activities. ^ ^ 

jl . Through designings classroom charts, the teacher is forced to clarify 

in his/her own mind the content 6f the desson. 

8.. Classroom char^p build upon systematic task anS concept analysis.* 

9. Classroom charts enable the teacher to review previous concepts and 
vocabulary at the beginning of a new lesson. 

10. Classroom charts ^can be independently utilized by small groups of 
lea/ners.to attaili instructional objectives. 

lU ^^assroom , charts ^are especially useful for nonverbal presentation of ^ 

< 

cpmplex tasks *^nd. concepts. < 

12. Classroom charts can be easily used by paraprofession^ls and vo^jinteers. 
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Module X; Class room Grap hics for Handicapped Children 

_ ^ enable the teacher to prepare suitable charts for 
handicapped children, * , 

2. Graphics ran be used to present * complex ta^ks and concepts in a' 
nonverbal fashion to the handicapped learner. 

3. Teachefs caft use graphic skills to ^ake attractive in st ructional 

"> 

materials. / 

4. Graphic skills can ^e-applied to a' wide variety of instructional media. 

5. Where commercial materials are not available for specific needs, the 
teacher can produce tailor-made visual materials for 'clarifying concepts. 

6. There are many siiyplified techniques which enable an average teacher 



28, 



to achieve professional-looking results. These techniques are not currently 
available in trainip^ programs for teachers of the handicapped. 



7. Simple graphics can be used as effective reinforcers for handicapped 
learners. \ ^ 

8. Teacher-made graphic materials cost just a- fraction of commercially 
produced materials. > » ^ 

9. Locally produced graphics readily feflect local conditions; they are 
more personally meaningful to the handicapped. 

16. Many basic graphic skills can be taught to paraprof essionals and 
•parents whd wish to contribute to classroom activities. 

11. Teachers gain insights into'^^^he structure of tasks and concepts when 
they attempt to grap^iically represent ffiem. f 

12, Locally designed graphic materials can be shared among teachers in 
order to build up local resources. 
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Module X I: Vreparing Tutorinfe, Materials \ 
: — -r ^ I 

1. Tutoring aatf^^als form the core of instructional assistancer^ by 
paraprofessionals and parents. 



2. Tutoring materials support peer-tutoring activities in which . 
handicapped children learn both as tutors and students. 

3'. Tutoring materials integrate the instruction'al^content and th© strategy. 
4. The teacher can prepare tutoring materials on high priority lesson topics. 
"5. Tutoring materials fya'^e self-contained flexibility which permits a high 
degree of individualization, < .^ 

6, No previous training is necessary for the use of tutoring materials. 
This enalTles the teacher to tap volunteer or peer resources without 
setting up a training system, 

7, Tutoring materials' have built-in reinforcement for Che success of the 

■~ ' ■ • ^ 

handicapped learners, 

8, Tutoring materials can be easily incorporated into lesson plans, ^ 

9, The use of tutoring has been nationally validated 'over a period of 
yeiirs and found effective (Ellson, 1974), 

10, Tutoring' materials undergo repeated learner verification and 
revision with handicapped children before they are implemented. 
Learner Analysis 

The target population for the series was identified as pre-service 
and iuservice teachers of handicapped children. The term ''handicapped children 
in this context refers to children who are mildly fnehtally retarded, learning 
disabled, or emotionally disturbed. The "teachers" refers to trainees in 
special ediication courses, student teachers, teachers in special education 
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classroems, consulting teachbrs for the handicapped, and regular-class , 
, ' ' ^-^ . ^ • ' " ' ' ' / 

t&chers with handicapped children mains t reamed into their /:lassroom. / 

To analyze the characteristics of this group of trainees, a questionnaire 

r - ^ 

proposed by Thiagarajan, S«nmel, and Semmel {197^) was used. Figure 
2.1 shows the questionnaire, ^ince only minor variations occurred^ among 



th^ learner analyses for eacb icodule, only the results of two of them are 
shown in Figures 2.2 and i\3, as sampleJl,, ^ 

Context Analysis / ^] 



■ \ 

f^o determine the cox^itions and constraints under which the modules 
would be used, a context analysis questionnaire wa^s employed. This questionnaire 
is shown in Figure 2.4. As the context was constant acros^ all modules, 
the results of the context analysis for the Task Analysis module are given % 
in Figure 2.5, as an example of the context for* all modules, ^ 
Specification of Instihjctional Requirements ^ 

Based on the needs, learner, and context analyses, a 3et of instruc- 
tional requirements for each of the modules was specified. These require- 
ments wpre listed tinder three headings: content requirements, style and 
format requirements, and'^utilization 'requirements . Ahe content require- r 
ments differed between modules, whereas the styla, format, and utilization 
requirements remained constants Figures 2.6 provides the style, format, 
and utilization requirements for all the modules. Figures 2.7 through 
2.17 summarizes the contents requirements for each of the modules. 
Task Analysis ^ / 

Based on interviews with subject-matter experts, instructional developers, 
sjSecial education teachers and a study of the available literature on the 
various topics for the modules, task analyses were performed. Each task analysis 
began with the specification of the main competency to be acguired by the 
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Sub ject -Matter Competence 

1. At what' levels are the trainees' current knowledge and skills in 
the subject-matter area? ' * 

2. What background experiences 'do the. trainees have in the subject- 
matte;? area? , . ^ . ^ - 

3. -jire the trainees likely to have any major misconceptions in the 
^tofiub ject -matter area? 

Attitudes . ^ 



1 Atritiifipq . f ^ 



4. i\i at are the general attitudes of the trainees toward the instructional 
content?' Are there any subtopics within the content toward which the 
trainees are likely'^to feel very positive or very negative? 

5. Wj/at prefe'rences for instructional format and me^dia do the trainees 
Hfave? " }' . \ ^ 

' Language ^ . ) ' 

•a 

6. What is the language'* level of the trainees? How much of the special- 
ized terminology is. in tl;ieir vocabularies? 

7. What preferences for style .of language (e.g., conversational or . 
: schol)arly) do the trainees have? • 

J^opl Skills 

8. Do the trainees, have any sensory -perceptual deficiencies that will 
require specia^, attention? 

9. Can the trainees handle the instructional materials and equipment? 



Figure 2,1, Learner analysis questionnaire. 
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Subject-Matter Competence 

Trainees have considerable theoretical knowledge of different 
types of handicapped children and special classrooms. They are 
^knowledgeable in specific' curricular areas; able to work with a topic 
for instructional game design. They have heard about instructional 
games and have. seen them being used in special classrooms. However, 
very few of them have considered the possibility of designing a gajne. 
Their conception of instructional games is mostly limited to fun'S^ac- P 
tivities and %usy work.** 

Attitudes 

The trainees' general attitude toward designing instructional 
games is. positive, although they are somewhat skeptical as. to the games ' 
uses. Most of them believe that a game could be designed very easily, 
and the amount of time required for the design, tryout , and modification 
of a game will increase their skepticism. ^ 

These trainees do not like a textbook -lecture approach. They will 
respond positively to a self-instructional media package. . 

"? ■ ' 

Language / 

Specialized instructional -design and game -design terminology is not a 
part of the trainees' vocabularies. They can, however, handle fairly 
sophisticated terminolpgy about handicapped children and special education. 
Trainee preference is'for a conversational , rather than, a '^'teXtbookish , 
style. 

Tool. Skills 



Trainees do not have any major handicapping conditions. They will be 
able to handj^le media equipment with some instructions. 



Figure 2.2 Learner analysis for the audio-visual training module on instruc- 
"tional games for handicapped children. 
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Sub ject -Matter Competence 

Trainees have received some degree of professional training in educa- 
tion, and some knowledge —either theoretical or practical— of handicapped 
children. Some teacher training programs require art education and/or 
audio-visual courses while others do not , so the design of this module assumes 
no previous special knowledge or expertise in producing classroom visual 
materials, 

'^Attitudes 



Trainee attitudes toward use of graphic materials in the classroom range 
from positive to very positive. Self-appraisal of trainee ability to pro- 
duce satisfactory classroom materials of their own range 'from very negative 

to slightly positive, 

r 

Trainee attitudes toward the use of individually accessable self-paced 
materials is generally positive, with the reservation that most learners are 
uneasy about being asked to operate audio-visual machinery. 

Language 

Trainees possess a sophisticated vocabulary about education, but gener- 
ally have little background in the use of technical art or. uudio-visual terms 
They prefer simple, conversational English with concrete and familiar 
examples, and a minimum of technical jargon. 



Tool Skills ^ 



^ Trainees do not have Luiy major handicapping conditions , but are untrained 
in the manipulative skills required in assembling graphic art materials. 



Figure 2^3 Learner analysis for an audio-visual training module on classroom 
graphics for handicapped children. 
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1. Who are the major target-trainees' 



2/ Is the material to be used with an instructor? 



3. What major delivery systems are required? 



4. How is the material to be introduced and integrated into a total 
program? 



5. What support facilities are available? 



6. Ifliat media equipment is available? 



7. \fliat extrinsic reward systems are operative? N 



8. What type of testing and grading is employed? 



9. What are the cost constraints? 



10. What are the scheduling constrai^its? 



Figure 2.4 Context analysis questionnaire, 
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1. Target-trainees . Both pre-service and inseryice teachers of the 
handicapped . 

2. Instructor . For inservice trainees, a coordinator issues the ta^k 
analysis material and monitors its use. For pre-service train'ees^ 
there is ^a faculty advisor. 

3. Delivery systems . Essentially for individual or sm^ll-groiip use, 
_but capable of belong used with large groups as well. 

4. Introduction/integration into a total program . Modular format, to 
permit flexi^ble use in a variety of special education courses. 

5. Utilization facilities . Learning resource centers, libraries, 
study carrels, student home facilities. 

6. Media equipment . Individual filmstrip viewers, audiocassette players, 
synchronized-sound filmstrip viewers. 

7. Extrinsic reward system . For inservice teachers, the task analysis 
module can form part of a course for college credit, i.e. be applied 
toward certification. For pre-service trainees, thie module contributes 
toward course credit. J 

8. Testing and grading . As the module is competency-based, tests are 
performance-oriented and grading follows a mastery-learning format. 

9. C ost constraints . Under^ $50 purchase priCje for the complete module. 

10. Scheduling constraints . The module must be" of less th^^^ 6^' minutes 
duration, and provide for approximately 30 to 60 minute of follow- 
up activities. 

. \j ^ 

Figure 2.5 Context analysis for an audio-visual training module on task 
analysis. 
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Style and Format Requirements 

1. Assume minimal competencies on the part of the trainee related to 
the content of the module . 

2. Use a conversational, but at the same time professional, lai^^guage with 
a minimum of technical terminology. 1^ 

•3. ' Incorporate a large .number of examples that relate vex5^ speci fic^al ly 
.flo the problems teachers of the handicapped face every day. 

4. Provide ample opportunity for actual practice' of the preinstructional 

1 

competencies presented in the module. 
5\ Use a variety of teachers from all walks of life and from various 

ethnic backgrounpls as model teachers with whom trainees ''can identify. 
Utilisation Requirements ^ - ^ 

1. The module should be self-contained, without any need for an instructor. 

2. The moduli should permit flexible use with individuals, small groups, 
• and la"rge groups. | 

3. The module should be portablr ti rmit easy delivery to different places. 

4. The module should be comp /.e with the most commcfnly available ^ilmstrip 
projectors and audio cassette recorders . 

5. The cost of the module should not exceed $50. 

6. The actual viewing time for the module shu^ld not exceed 30 minutes. 



Figure Specification of instructional requirements for all modules in 

the preinstructional competencies series : style, ^ format require- 
ments and utili::ation requirements. 
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1. 


Identify the major components of an instructional objective. Provide 




practice in discriminating between acceptable and unacceptable behavioral 




terms. , . 


2. 


Provide practice in writing' behavioral objectives complete with 




acceptable conditions and standards. 


3. 


Provide practice' in assembling series of behavioral objectives that 




coherently relate to one another.. 


4. 


Have trainees vyrite, edit and rewrite behavioral objectives. Get 




them to cross edit and tritique each other in order to eliminate 




trivial types of objectives. 



Figure 2.7 Content requirements for specifying behavior objectives. 
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J . .. 

1. Outline a simple yet systematic procedure for doing a t^sk analysis 
using nontechnical language. 

2. Show how task analysis organizes the content of le^jjiing into a 
hierarchical structure in which all parts are logically connected. 

3. Specify means of pinpointing handicapped leam^i's' entry levels. 
4; Link task analysis to the stiaicturing learning sequentes. 

5. Outline ways the'teacher ca^ use task analysis to 1.) communicate with 
parents, colleagues, and administrators, 2,) diagnose handicapped 
learners, and 3.) evaluate the performance of a child. 



Figure 2.8 Content requirement^^^or task analysis, 
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1. . Shoirf, how task analysis forms the t/ase £pr lesson planning. Stress 

N, 

that this approach is less time-consuming than many other lesson- 
planning techniques. 

2. Provide a lesson plan form that links the task analysis to the sys- 
tematic specification of behavioral objectives for a lesson, selec- 
tion of materials, specification of teacher and pupil activities, 
statement of test items, and form of remediation to apply when a 
handicapped child does not meet criterion. 

3. Present lesson planning through task analysis as a means of providing 
a solid rationale for all lesson activities in a form others, partic- 
ularly parents, can comprehend. t 

4. -Offer lesson planning* through task analysis as a means of building up 

over the years systematically planned lessons which can be shared among 
teachers , 



Figure ^-^ Content requirements for lesson planning through task analysis, 
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1. Identify concept analysis as the most effective means of structuririg 
strategies for providing handicapped learners with the host of funda- 
mental concepts they require to cope with the world around them. The 
emphasis must be on the prime importance of effective concept teaching 
for the handicapped child. 

2., Describe in detail how a teacher can define a concept in terms of its 
critical and variable attributes.' 

3. Provide practice »in creating exaiiiples^> nonexamples , and matched positive 
and 'negative examples as a means of clarifying the c^' .leal attributes 



of a concept to the handicapped learner. 
'4. Stress the importance of generalization and discrimination in concept 



acquisition. Relate this to the problems of over- and undergeneration . 



Figure 2.10 Content requirements . for concept analysis. 
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1. Introduce lesson ^planning. 'ithrough the use of concept analysis as ^ 
means of systematically s\:ructuring vcdncept lessons for handicapped 
learners, i.e.^ a ii\eans of translating concept analysis to a plan of action, 

.2. Outline the procedure for planning a^ concept lesson including: 

incorporation of logical sets of examples and nonexamples to intr-^-^ 
duce a concept, specification of learner activities, specification 
of test items, and decisj n points for remedia^ instruction. Stress, 
that this lesson-plan^iing approach reduces/the time a teacher requires 
to design useful and usable lesson plans. 

3. Link important factors such as communicability of the lesson plan, 
reusability of accumulated' ^~^^ept lesson plans, and the possibility 

of sharing plans with other teachers, to the rf^nt ben-ficial aspects 

of this technique 

4. Stress that this Ic; n-planning approach harmonizes with lesson 
planning through task analysis. 

5. As the^entire concept analysis technique is very new to the trainees, 
1^ provide profuse and f^i liar examples to illustrate how concept lesson 

planning has been utilized by other teachers of the handicapped. 



Figure 2.11 Content' requirements Jor planning a concept lesson. 
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1. Discuss the use, modification, and adaptation of instructional games 
for handicapped children. 

2. Provide a rationale for the use of instructional games with handicapped 
children. ^ 

3. Offer some typical frame games ^s examples of ganies which lend them- 
selves to adaptation for new content and use in a wide variety of cur- 
riculum areas . 

\ 

Figure 2.12 Content requirements for instructional games for handicapped • children. 
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1. Describe 'what a curis^icul urn ' package is and show how it has been sys- 
tematically developed to assist teachers of handicapped learners individ- 
ualize more readily. 

2. Provide a model forgteachers to use in assessing the usability of a 
curriculum package for his/h(?r context. 

3. Point out the .«T^v ant ages and disadvantages curriculum packages have for 
teachers of the handicapped. 



Figure 2,13 Content requirements for choosing a curriculum' package. 
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1. Describe how teacher-made reading materials provide more personally 
meaningful reading instruction for the handicapped learner, and how this 
tviM* of locally produced materials, through involvement of both 
teacher cind child, can increase a child's interest in reading, 

2. Provide a systematic procedure for teachers to follow in preparing 
their own reading materials. 

3. Discuss ways teachers can utilize parents and volunteers in the pre- 
paration of teacher-made reading materials. 

■A. 

4. Include methods for incorporating teacher-made reading materials with 
'"^commercially available curriculum materials. 



I ■ 

1 



Figure 2.14 Content requirements for teacher-made reading materials. 
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Demorv^trate how classroom charts can stimulate the interest of handi- 

/ ■ . y 

capped learners in a wide variety of curricular a'p^as. 
'2. , Integrate tne design of classroom charts with the various types of 

analyses teachers can use to plan lessons. 
3. Provide an assortment of design techniques for preparing classroom charts. . 

— : — : 

^wft^gure ^•■'•^ Content requirements for class room ''charts for handicapped children, 
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1. Present basic information related to possibilities and limitations v 
involved in designing anjd using teacher-made classroom visual materials 

2. Discuss basic design principles involved in building successful 
classroom graphic materiaLs. 

3. Provide ^trainee practice and exercises for acquiring rudimentary 
'skills in designing and producing typical classroonf visuals • 



Figure. 2.16 Content requirements for .^1 ass room graphics for handicapped children. 
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1, Describe a systematic procedure teachers can follow for preparing 
tutoring materials which can be used by paraprofessionals , volunteers 
and parents . ^ 

2, Relate the tutoring materials to the need for individualization on 
the part of handicapped learners and explain how tlie "tutoraid" 
approach to the preparation of tutoring materials permits the teacher 
to be aware of "what both tutor and child are doing at any moment * 

3, Describe the procedures a teacher can fallow in preparing his/her 

\; * . ? ■ ' . 

tutoring materials for learner verification and revision. 



Figure 2.17 Content requirements far preparing tutoring materials. 
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trainee. These main tasks- were then analyzed into the sufficient and 
necessary subtasks required ftyr the cdmpetency. The subtasks were then 
further analyzed into prerequisite competencies until the entiy level 
of the trainees was reached. The task .analyses were then carefully 
reviewed by both content experts and instructional developers. All trivial, . 
superfluous, and unnecessary subtasks were eliminated. The leanest possiblie 

I: . ^ 

Structure for -the acquisition of the specified main competency was thus 

derived. Figures 2,18 to 2,28 contain the final edited versions of the task 

• J, ^ 

analyses for each of the mosiules, ' 

Specification of ^Instructional Objectives ^ x ^ 

Bas%d oh the task analysis performed for each of the modules, sets of 
instructional objectives were derived. These objectives were matched 
against the instructional requirements in order to ensure that .they harmonized 
with skills teachers of handicapped children actually require, Wherevei^dis- 

. ■ / 

crepancies between the requirements and the objectives were discovered, 
changes were made either by deleting superfluous objectives or adding necessary 
ones. The objectives for e^ch of the modules are contained in Figures 2,29 
to 2:^39, Both the general overall objective and the enabling objectives for 
'each module are given, > 
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Stating a comprehensive set of 
behavioral objectives for a lesson 



Writing behavioral objective^ | ■ | Editing behaviorarp 



Specifying behav- 
ioral terms k. 



Identifying suitable 
action verbs ^ 



1- 



bjectives 





_ . _ ^ 

Specifying 




Specifying 






conditions 




standards 





Identifying unsuitable 
action verbs 



Figure 2.18 Task analysis for the module on specifying behavioral objectives. 
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examples 




Figure* 2.19 Task analysis for the module on concept analysis. 
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Figure 2,20lfask analysis for the module on task analysis. 
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Figure 2.21 Task analysis for the module on lesson planning through task analysis. 
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Figure 2.22 Task analysis for the module on planning a concept lesson. 
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Figure 2.23 Task analysis for the module on choosing a curriculum package. 



Identifying 




Stating prin- 




Preparing a 


disadvantages ' 


•< 

1 


ciples of 




.checklist for 


of a curricu- 

liim •norl'Qrrfl 


i 


selection, 


\ 


selection 



6o 



PRir 

















tional 


instruc- 
games 









^^^^ ^^sing y modifying and adapting instructional games 



^difyyig instruc- 
tional" games s 




Conducting | 

a game.. ^ | 



Adapting instruc- 
tional games 



Trying out 
a game 



^^;^e vising 
tlve -game 













Selecting 




Loading 


a frame 




the frame 



Figure 2,24 Task analysis for the module on instructional games for handicapped children. 
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'Figure 2.25 Task analysis for the module ofl teacher -made reading materials. ^ 
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Develop Appropriate Classroom Charts 
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.^Figu| 2.26 . Task analysis for the mociule on preparing classroom charts for handicapped children. 
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I Preparing, a mounted poster containing illustrations, drawings, and captions 



Identifying 
"comniercial 
sources of 
'illustra- 
tions 






/ 


1 


Captioning 


Mouating 





r 


Selec 
tea/ 
^sheet 


ting 



Iden 

methods for 
manipulating 
drawings 




' Enlarging 




Reducing 


a drawing 




a drawing 



Ideiiti*,. 




Caption- 




Identi- 


fying ■ - 




ing 




fying 


mechan- 




using 




methods 


ical 




dry 




of 


methods . 




trans- 




mount- - , 


of ' 




'fer 




ing 


caption- 




letters 




with 


ing 




tissue 




Figure 2.27 Task, analysis for the module on classroom graphics for handicapped children. 
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Designifig, testing, and revising tutoring ' materials 



Preparing content 
materials 



Selec 


ting 


suitable 


topic 





Outlining 

tutoring 

lesson 



Preparing instruction 
for tutors 



Preparing 
flash ■ 
cards 



Designing 
lesson ■ 
strateg^^ 



Designing 

frame 

strategy 



(9- 



Tryout revision 
of materials 



Preparing 
flowchart 



Try. ■ 
oiit 
with 
child 



Tryout 
with . 
tutor 



Tryout 

with 

tutor 

and 

child 



Figure 2.28 Task analysis for the niodqle.on preparing tutoring 'materials. 
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GENERAL OBJECTIVE i The teacher trainee-ivi 11 be able to state a 

comprehensive set of behavioral objectives for a lesson of his/her 
own choice. 

SPECIFIC OBJECTIVES : ^ ^ ) 

1. IDj^NTIFY action verbs which are suitable for use in statements of 
•^behavioral objectives. 

2. IDENTIFY instructional objectives which are unacceptable even though 
they contain a behavioral term. - 

3. WRITE a qpmplete instructional objective which contains a 
behavioral term, conditions and standards. 

4. ' Given an incomplete behavioral objective, ADD. suitable standards 
^ for the student's performance. 

■S\ EDIT and REWRITE a behavioral objective using a checklist. 



Figure 2.29 Objectives for the module_on specifying behavioral objectives. 

/ ■ ■ - 
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GENERAL OBJECTIVE: Upon completion of the module, the teacher 
.will be abl\e to analyze a self-selected lesson topic into a hier- 
' archical set\)f necessary and sufficient subtasks . 



SPECIFIC OBJECTIVES: 

1. SPECIFY a main task appropriate for undergoing task analysis, 

2. IDENTIFY subtasks at the preceding level of difficulty. 



TREAT each subtask as a main task and IDENTIFY simpler tasks 
at preceding levels of difficulty . 



4. STOP the analysis when a subtask reaches tl^^ pupij^r^ entry level. 



CPNVERT 



' ^tall 



k analysis into a learning sequence, 



4 



Figure 2.30 Objectives for the module on task analysis. 
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GENERAL. OBJECTIVE : Upon completion of the module, you will -be able to 
prepare a lesson plan based on an analysis of a main task. 



SPECIFIC OBJECTIVES : 

1. CONVERT each item of a task analysis to a behavioral objective, 

2. SPKCIFY materials required to help learners attain each stated 
objective in the lesson plan. 

3. SPECIFY teacher activities whioh will help the learners attain 



the objectives in the lesson plan. 



4. Specify children's activities which will help them attain ieach 
objective in the lesson plan. ^ 

5. CONSTRUCT, a criterion item to test the attainment of each 
>^objective in the lesson plan. ' 



"Figure ^.31 Objectives for the module on lesson planning through task an^alys 
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GENERAL OBJECTIVE: The teacher trainee will be able to select a 
fundamental coiic^pt in the lesson he/she i:eaches, identify the critical 
^ and irrelevant attributes of the concept, and collect o^create a, 
set of suit abie examples and non^xample's for teaching .and testing. 

■ ■ "A ■ ■ 



I a 6iB. 



-J. 



SPECIFIC OBJECTIVES 



1. 



and GIVE EXAMPLES of the following concepts: 
(a) concept, (b) example, (c) nonexample^ (d) attribute, (e)^ critical 
attribute ^ and (f) irrelevant attribute*.-,. / y 

2 .^A IDENTIFY oritioal and irrelevant attributes of a concept selected 
xrom any lesson youyplan to teach. I- k 

'3.^ COLLECT or CREATE a/set f (a) c^ar examples and (b) dijvet^ent 
, examples of the cc5rtcept you selected, using the lists of critical 
l.^d^ijre levant attribuics. ^ 

4. COLLECT or CREATE a set' of (a) close-in nonexamples and (b) matched 
/ example-nonexample pairs of the concept you selected using the 
lists of critical and irrelevant attributes. , 



Figure 2,32 Objectives- for' the module on concept analysis. 
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GENERAL OBJEpTIVf : Thfe teacher wiU be. able to prepare a lesson f9r 
teaching a con(ce*pt of nis/her own choice,. Tha lesson plan should in- 
clude the sequence of steps, entr>v /tests and posttests, the nature 
of ejcaji^lds to be used in di f :^renT sta&e;s of teaching and testing, 
and specific^ation of learner responpses. > . > 

\ , / 1 

' ■ ' •• . 

_ . _ - ■ I ^ 

SPECIFIC OBJE(^TIV£S: r 



1. PREPARE anWntry test to check the learner for prerequisite > /'/ 

discriminations. w i 



Figure 2.33^, Objectives for the module^ oji plannijig concept lesson.^ 



« - 



81 



y 



2 . PREPARE, a classification test to check the learner' ^ mastery > 
of the coacepf 'and to^ diagnose his error p^tems, \ 

3. SPECIFY .the objective for k concept lesson in terms of general-^' 
izations and discrimina'tions to be demonsti^ated by the learner, ^ . ^ 

4, ^SELECT a 5et oj clear ex^mpLe* to introduce^ the »tpncept to^ 

^ the learners, ■ % \ - - ' 

^ - / \ ' ,^.\ ^ 

S\ SELECT matched sets o/ examples and nonexamples to provide . 
^ discrimination tr.airiing to learners, * ^ *' , 

6, SELECT a set of divergent examples to extend the. learner's 

ran^e of generalization. ' V ' 

\ ^ ■ > ■ ' s " ^ ' ^ 

7.. PREPARE" a set of examples ^nd nonexamples tp'iprSvide practice . 
to the learners in generalizing the concept.^ '* ^ 

8, INTER^^^ individtia-l ^^arner 's performance pn the classification 

test . ..^ , ■ . ; ^ ^ . - 

9. PR&§CRIBE suitable remedial instruction'-for the individual le-am- 
er on the basis of- his performance on the classification test. - 

X ■ \ ^ — . - ■ . . ■ 
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GENE RAL ^OBJECT! VE : The trainee will be able to modify instructional 
jgaines for use with handicapped children in his/her classroom and 
^dapt existing ''gajnes to present new topics . 


J 


. SPECIFIC OBjicTIVES: ^ , 




1. 


EXPLAIN the ^advantages of using instructional games, .with 
handicapped 'children . ^ • 


i 


2. 


Given sufficient directions, PREPARE play materials for an' 
instructional game and USE them with-handicapped children. 




3. ' 


TRY OUT 'a given instructional game with handicapped children 
and MODIFY it to make it m(3re suitable for the children. 




. 4. 


ADAPT a given instructional game to teach a new Jnsf ruction al 
topic y ^ - 

- \.- 




s 


• ' ° ^ ^- : 





Figure 2.34 01p*jecti\^es for the/inodule on instructional games for handicapped 
"children^ * • ^ ; > - 
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GENERAL OBJECTIviS: the trainee shall list the seven critical attri-. 
butes of all )goQd packages, list their advantages and disadvantages/ 
and apply principles of selection in choosing a curriculum package. ' 

• / — ^ 

SPECIFIC OBJECTIVES: ; . 

1. STATE sevei^al critical attributes of' a curriculum package . 

2. LIST- the advant^ages of using curriculum packages in thQ classroom. 

A ■ ^ ' • - ' ' i ' J 

3. ' LIST the disadvantages of using curriculum packages iJi the 



. » cL^sr(yom. 



...4:* IDENTIFY appropriate places to get information abaut curriculum 
packages/ / 

5. STATE the "ptinciples of curriculum package^ select ion^f or lis-e in 
• . the c^&sroora. - I * • ' 

6. ' USB^. a checf^Tdst to '^help make a selectipn' of a curriculum package. 



•It 

Figure 2.35 Objectives fox^ithe^mpdule on cjvobsi'jjiig -a curriculum package. 
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GENERAL OBJECTIVE^: The trainee shall plan and write materials 
.matched to the reading^achievement level and interests o'f 
^handicapped children. 



SPECIFIC Pj^JECTIVES: • . ' ' 

1, LfST^the steps in planning materials. 

^2, WRITE materials at a selected grade level, ^ 

3. REWRITE these n\ateriais at lower grade levels:,**. . 

- 4, DESIGN a criterion test to ascertain whether -^tud^ts are 
meeting the objectives set for the materials, ' ^ >WA 




Figure 2.36 Objectives for the moSnle on' teacher -made reading materials. 



GENERAL OBJECTIVE: The trainee shall be able to develop a classroom 
/^-^^art of his/her own, taking into consideration the nature of the- 

learners, the content, to be taught, the medium to be used, the timj.rfg 
of presentation , and the chart ^s intended purpose. 

' ^^PECIFIC OBJECTIVES:" 

1, DEFINE classroom charts in t^rms of format and purpose. 

2. IDENTIFY three media in which classroom charts can be produced. 
S. LIST a variety of uses to which classroom charts can be put. 

4. RELATE the educational uses of classroom charts 4^ thfe timing of 
their presentation . 

5. OUTLINE six steps -involved in planning a classroom chart. 
,6. STATE advantages and limitations of the use of classroom charts. 

J- 7.' PL'AN a classroom chart for specified educational purpose . 



' — ^ ^— — : ^: ^ 

Figure 2,57 Objectives for the module on classroom charts. 



GENERAL OBJECTIVE: Tftqjjj^udent will acquire a basic body^of know- 
ledge ^about available possibilities for using , graphic materials in 
the classroom and will learn four specific skills'for making his own 
visual materials, ^ • 



SPECIFIC OBJECTIVES: 

1, LIST a variety of presentation modes which use teacher-made 
graphic materials, 

2,, ENLARGE or REDUCE a line drawi^ using the squaring method. 

3. . CREATE captions suitable' for^ classroom use uti^lizing dry 
transfer letters. ' 



4. MOUNT materials for display using the permanent rubber cement ^ 

mounting technique, - . . \ ■ 

CREATE^ a classroom poster using manipul ktion^o^ line drawings ^ 
tear sheets, dry transfer letters^ and rubber cement, 



Figure 2,38 Objectives^ for the module on classroom graphics for handicapped 
children, " , , 
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GENERAL OBJECTIVE: The teacher will be able to prepare, tryout , and 
revise a specific type of tutoring Icit which includes a* set of flash- 
cards for the learner; and .a perOTrmance aid for the tutor. 



1 . 

SPECrFIC OfeJECTIVESf ' ^ 

1. USE tutoring materials in. .a simulated situation-.- 

> " \, ■ . > 

2. SELECT a suitable skill to be taught through the tut(!>ring materials. 

0 _ 

3. OUTLINE a tutorial lesson .on tKe' selected skill. 



4, ^ PREPARE a set of flashcards 'for use in .tutoring tKe! selected skill, 

5. DESJGIN the strategy for ^ tutoring lesson. ^ • . 



'6. DESIGN the strategy for individual items of the less6n, 

7. PREPARE a per^rmance aid for'-^the tutor's reference;. 

8. TEST the tutoring- m'ateri al with a chil^J^^r^'make suitable 
revisions, > ^- . 

9. TEST the tutoring material with a tutor , and make suitable 
revision^ , . • 

10. TEST tutoring materials with a tut^.r and a child and maice 
suitable :i^visions. , 



Figure 2r<39 Objectives for the module on designing tutoring matertcf|^§,<^^ 



CHAPTER 3 

DESIGN AND DEVELOPMENT OF THE MODULES 
Once all the analyses were completed and the instructional require- 
ments and objectives specified, the design and production of the actual 
audio-visual modules began. The activities carried out in this stage 
are described below., ^ 

Media Allocation . r ■ 

The preselected -audio-visual media, combination consisted of a re- 

■ 0 

${Jt^^ book, audiocassette and filmstrip. Once the objectives^ and re- 
quirements were specified, allocation 'of ^ the instructional message to these 

-different media- components took plate. .Following-- ther rationale employed 

■ ' . « , ■ 
in th^ revised 4-D Model, each cpmponent^ was.-designed tp. cara^.iBfcat part 

of instruction for which it was be^t. suited. 



it ^ 



Design of* Response Book . . " 

The* response book for each module contains thet following four 

m^jor items: ' ^' . ^ ^ 

" "^^ . . . * 

* 1;^ The objectives of the module. ^ ^ 

2^ Criterion-referenced test items which match these objectives. 

3. A permanent record "^of the t;.rain|es^ responses and hence a seP^ 
of pei*sonal guidelines /or Implementing the preinstructional 
competencies. pon1;ai'oed^ 'in ti\e -Module in their own classrooms. 

H 4. Useful hints ajiid fol-low-yp readings'.' , 

' * v ■ ■■ ' ^."^i. . • " „ 

The criterion-refe2:enQed HtemS were developed from the objectives. 

^ ^ ' ' ' , . '"'^ . ' ■ ^ 

^As the script for the .audiocassette v^as developed, these items were * 
adapted to fit a story .line. Examination of any of the response books 
shows the match between the objective^ and th^^ ^i:4,terioi>^^ftems. ^>Figurfe 3.1 



Objective 1: 

SELECT a suitable skill to be taught through the^use.of tutoring materials. 



Criterion Item: 

What skill are you going to teach with your tutoring inateriaT? 
Describe it briefly here. * 



Objective 2: 

OUTLINE. a tutorial lesson on the selected skill, 



Criterion It^em: ^ " > 

Prepare an outline for your tutoring material by: " ^ 
i. Writing down^the specific objective, 
> 2, Specifying the flashcard format at different levels 

of difficulty . 



Objective 3: 

BgEPARE a set Q^fl^sh cards for iise in tutoring the selected skill. 



C^:^terion'' ^tem: 

Prepare a complete set of flash cards^^ :You will need a packet of 3 x 5 
index cards and felt-tipped pens of 4iffereht thicknesses for this task. 

: : — ^ 3^.^ — • 



Objective 4: \ 
DESIGN the strategy for a tutoring" 1 




^friterion Item: 



i ^. V ^D^sign the strategy for your tutor ing'^les son hy\s pacifying: 




l.r Criterion ^'or mastery, 
.2, Procedure for reviewing flash- cards . ' ^ ^ 

3,- Sequence^ of presentation of the flash, cards 



' .figure 3.1 Objectives and matching criterion items for the modij(le on deisigning 
'tutoring^materials . I ; \ ^' 
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Objective 5: 

DESIGN the strategy for this individual items o'f the lesson. 



Criterion Itdftn: 

^Design. a tutoring strategy for individual flash cards in your tutoring 
materials ^ ^* • 

. Write down a list. Make sure that these steps form a brightening sequence 
from the most , difficult form of the task to the easiest one. 



Objective 6: ^ 
PREPARE a per^rmance aid for the tutor's reference. 



Criterion Item: * - ■ % * 

Using the tutoring* strategy for the individual flash cards which you have 
specified, prepare a flowchart for. use by your tutors* \ ' 




J 

c 



TRY OUT the tutoring material with a child and make necessary revisions, 



Criterion Item: 



Try out your . tutoring ^^teri al with four or five indi-^idual children. Make 
suitable r&visions on the basis of their performance , 



Objective. 8 : 



TRY OUT the tutoring material with a t^utor and. make suitable revisions, 



Criterion Item: 



; Try 'out your tutoring ma tax ial with one or two individual tut6ts„ Have tl^em 
tutor^-you- while you pla,y the role a s^dw child, ^ Mak^ suitable moSifiqafiions., 



Figure Continued. 



Objective 9 : ^ • - 

TRY OUT the tutoring material with a tutror aM a child and make suitable 
revisions. 



Criterion Item: 

Try out your tutoring material with- one or more tutors and children. Make 
' suitable modifications . . 



Figure 3.1 Continued. 
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shows the match between objectives and the criterion items for the module 
on designing tutoring materials. 
S j^ipting ^ . ^ 

The audio script for each module follows a standard format, trai^iees 
are introduced to a teacher or teachers of the handicapped who are 
engaged in trying to solve some particuiar problem. Through narration 
and dialogue in a school setting, trainees vicariously share in the 
problems and experiences of these teachers. The scripts always lead 
the trainees toward each criterion item of the response books > Trainees 
are then required to respond actively with reference to their own personal 
experiences. How would th^ help the teachers? What woul^i they da in . 
planiVing their own programs? The scripts provide feedback to the 
trainees, allowing them to evaluate their own responses « Figure 3,2 
pa?ovides a segment of a sample script that exemplifies Xhe techniques 
described above. The script segment is from the module on planning a 
concept lesson. Vl 
Visual Storyboarding ^ 

As each script evolved, so did the visual storyboard for* the module. 
In the design of the visuals, attention was paid to various principles 
of perception (Fleming, 1970) and to the careful integration "^of the visuals 
with the audio script. 'Hie -visual storyboard receiv^ed repeated evaluations 
from subject-matter experts and technical specialists , A^sample visual 
story-board is described irt^ verbal form beside the appropriate, text of a 



script segment from the module on designing tutoring materials (Figure 3.3) 

E:lpj^rt Appraisal i 

Each module was submitted for, repeated appraisal by experts. The 
* review panel ihcliided: . ^ 



Mr, ^ toner: .>^l'm going to s^tow you fnany " 
\ g more above^things , Watch carefully Is 

the 'penc^ ' abovS the hook -now? 

^ ChlldreM Yes. 



/ 

I 



Mr, S toner : Is the book above the pencil ' 
^ now? 

Children : Yes\ 

Mr. S toner : fAat^s^'^od, ' JohrT^which 
of the two thiftgs should be bigger? Is 
it the upper thing or'the lower thing? 

■ iSlHl' lower .thing, No ^ the upper- 

thing, , . , No, I guess the lower and upper 
thing:^ can be big, 

•^_^_v ■^^Q^gj' ' That's right, Johnl When 
you talk about above , you njeed two things^. 
But the top one can be big ^ or * the bottom^ 
one can be big^.^Qes; Ellen? ^ 

Ell en : Mr, Stoner, can both things be 
big? 

A' Mr . Stoner : That's -Very good, Ellen! 

j , In an 'above* sentence both things can be 
the same siz^. They can both be big 
or '-small Now watch these three pictures 

^ and tell me i f 'above' things are ^Iff^ys 

living things , ^ ,( fade out) 

^ Narrator : Ready for your observation 

test? Please, turn to page 8 for the quiz 
on Step 4' Turn off the tape while you 
work on this ^ 



QUIZ ON STEP 4 

^Given below are four questions based upon your recent observations of 
Mr. Stoner' s classroom. Read each question carefully and check the most 



Figure.,3,2 ..Script segment from the module 013 planning a concept lesson 
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appropriate" answei>(«] given belo»*^the question. You mav choose more than 

one stiterttative for e&ch ^question ^ if ivecessary. ^ ^ 

1. .ViTiat would you say is the purpose of fhis step? 

( ) To provide generalization training so that the learners 
could identify new examples. 



2. 



( 



( 



.ViThich of the following could be a specific objective - for this. step? 

■ ' ^ ' \ 

The learner shall identify the critical attributes in the 
examp les pres ented. 



To provide discrimination training so that' the learners 
could identify^ nonexamples . 

To provide training in both generalization and dis^^riniination. 



. The learner shall identify the variable attributes in the 
exajnples presented. 

3. What type of examples and nonexamples does the teacher use? 

( ) Clear-cut examples. 
( - ) Divergent examples. 

( j Matched pairs of exairipjes and nonexamples. 

4. VvTiat are the major teacher activities c '\ing this step? 

( ) Show the examples to the leame: . . 
( ) Show the ngnexampl es to the learners • 

( J ;\sk learners to identify the critical attributes in the 

examp 1 es . 

) Ask learfers to identify the yariable attributes in the 
examples . 

Please restart the audiotape after' completing this quiz . 



Figure ^.2 Continiled. 
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82. *''Sel€^6t a suitable 
'chi: 

(CAJ^TION) 

(Abundant combination) 



83, 



84, 



85. 



Qiild doing a math page. 
Tutor sitting on floor 
holding flowchart, 
• Angle over tiltor*s 
5houlder to shovv flow- 
chart and child. 
(LIVE SHOT) 

(SUM NATIVE COMBINATION) 

Child laboriously writing 
number in box on paper. 
(LIVT SHOT) 

(SUMMATIVE COMBINATION) 



Child looking intently 
at handful of pennies. 
(LIVE SHOT) 

(SUMMATIVE COMBINATION) 



begin these tryouts by se-, 

-A 

lecting a suitable child. Make sure 

St 

that this child represents the type 
of children for whom tha tutoring 
material 25 designed, ... 

^^/Tak^j him through the /nateria^is 
by following your own flowchart 
and lesson strategy , As you tutor, 
watch^for various problems . . • 

^^/ror example, during our t;ryouts 
with the addition tutoring aid we 
originally required the chil d to 
write the sum of the tw<^numbers in - 
the box. But this slowed- up ifihe 
tutoring procedure so much that we 
deci ded to requi re only an oral 
response „ There were a couple of 
other unanti^ci pated problems during • 



V 



the tryouts . . 



8^/ori ginally , w^e used pennies for^ 
our counters , but we found that the . 



Figure 3,3 Sample visual storyboard (in verbal form) with accompanying script 
segment "from the module or; designing tutoring materials. 
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86f Tvio sets of cards: one 

with thin mediam sized 
J fel^^ten numbers, the 
^ othe^^pn larger cards 

with ^Id magic marker 

nuinbers . - 

(PROP' SHOT) 

(SUMMATI'yE) 

87. Flowchart: 



TRY OUT 
YOURSELF 



REVISE 



J;, 




OUT 
WITH TUTOR 



(GRAPHIC) . 
(SUMMATIVE) 




Figure 3.3 ■ Continued. 
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children were' so distnacted by them - - 
that we had to shift to plain white . 
poker chips . ; . . 

^^/our original nuinbers were 

x. 

medmp-sized ones w^ritteTi with a • 
felt pen. After ^the tryout we 

shifted to lar'ger numbers written 

wizh a' magic marker^. ... ^ - 

four or five of these 

individual try outs with children 

andj revisions you should be able 

to ^ obtain consistent results i^ith 

•J 

yp.urs tutoring material . You are * • - 



r 



now ready for a tryout witJi an. 



actual tutor, 



i 




ERIC 



U 



1. Special education faculty members at the Center for Innovation » • 
• in Teaching the Handicapped, Indiana University. . 

2. Instructional developers at the Center for Innovation in Teach- 
ing th,e Handicapped and the Instructional Systems Technology' 
Department, Indiana University. 

3. ^ A professional editor. 

Sample questionnaires given to .experts are shown in Figures 3.4*?to 3.7, 
Revision ^ 

Ba^ed on feedback from experts, a number of revisions were carried out 
on each module. TTie specific revisions that were made are too numerous 
to list in this report. Hovever, some of the types of revisions which 
were carried out are given below: 

1. The language was simplified. 

2. Figures and illustrations were added to some' of the response 
books and to the visual storyboards. 

3. Examples were added. 

4. Follow-up activities and transfer exercises were increased, 
particularly in the analyses modules. ' 

5. Rearrangement of information to different components was carried 
out. In particular, some of the material contained in the visuals 
or on the audiotape were included in the response books for 
permanent reference. 

6. Trainee activities were altered and made mor-e relevant. 

7. The content in some of the modules , ^particularly the design 
- modules (and especially the Classroom Graphics module), was 

rese'quenced. 

97 . ' 
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Checklist: Appropriateness of Instructional Content 

Pi rections 

Critically inspect the instructional package and all adjunct 
materials. Evaluate the appropriateness of the material with respect 
to the goals and objectives of special education. Rate each item on 
the basis of 5 points for outstanding quality, 4 points for better 
than average, 3 points for- average, 2 points for below average, and 
1 point for unacceptable. Circle the appropriate number toindicate 
your rating. On the second section of this checklist, please give 
your suggestions for improving the materials. 

1. Relevance of the stated objectives of the material 

to the general goals of teaching exceptional children. 4 2 3 4 5 

2. Meaningfulness of the objectives to the teacher. .^1 2 3 4 5 

3. Meaningfulness of the objectives to the trainee,- 1 2 3 4 5 

4. Sources from which the objectives are derived.' ,1 2 3 4 5 

5. Stated rationale for the objectives.^ 2 3 4 5 

6. Relevance of the content to the^ objectives. 1 2 3 4 5 
s 7. Theoretical soundness of the content. 1 2 3 4. 5 

8. Adequacy of definitions and explanations. 1 2 3^5 

9. Use of technical terms, formulae, and notations. 1 2 3 4 5 

10. /Number of examples. • 1 2. 3 4 5 

11. Authenticity of examples. 1 2 3/ 4 5 



Suggestions : 



Figure 3,4 Que stioiln aire given to content specialists. 
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' , Checklist:^ Effectiveness of Instructional Materials 

Directions ' ^ * 

Critically inspect the instructional package. Suggest modifi- 
cations in* each of the following aspects for improving the effectiveness 
;of the material. 

1.- Statement of objectives 



2. Response book items' 



3. Instructional content 



4. Level of language 



5. Style of presentation 



6. Instructional activities 



7. Difficulty level 



8. Sequence of presentation 



9. Practice and review 



10. Feedback to trainee 



11. Instructor's manual 



EKLC 



Figure 3.5 Questionnaire given tf 

. . f 



educators . 
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' Checklist: FeasibiUty of Instructional Materials 
DiTe ctions 

Critically inspect the instructional package. Evaluate the 
usability of the material in a t>'pical school setting. Rate each 
item on the basis of 5 points for considerable usability, 4 points for 
better than average usability, 3 points for average usability, 2 points 
fqr below-average usability, and 1 point for virtual unusuability. " 
Circle the appropriate number to indicate your rating. 



1. 


• Adequacy of packaging. 


1 2 


3 


4 


5 


2. 


Availability of supplementary materials. 


.12 


3 


4 


5 


3. 


Reusability of the materials. 


12 


3" 


4 


5 


4. 


Equipment requirem^ents . 


12 


3 


4 


5 


5. 


Space requirements. 


1 2 


3 


4 


5 




"Preparation time. 


1 y2 


3 


4 


5 . 


7. 


Training time. 


•1 .2 


3 ' 


4 


5 


8. 


Scheduling requirement^. - 


1 2 


3 


4 


5 


9. ^ 


Cost. 


1 2 


3 


4 


5 ■ 


10. , 


Instructor's tnajiual . 


1- 2' 


3 


4 ' 


-5 


11. 


procedure for use. 


• 1 2 , 


3 


4 


5 


12. 


Flexibility of use. 


1 2 


3 


4 


5 


13. 


Special skills required fo^ use. 


1 2 


3 


4 


5 


14. 


Potential acceptance by teacher trainers. 




3 


4 


5 


15. 


Potential acceptance by teacher trainees. 


1 2 


3 


4 


5 
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Checkli'St: Language Revie^tf 



Di rections 



Rate the material on each of 
appropriate nuuiber in the five-po: 
rewrite the material as heeded. 



1 . Poorly ^organized 

2^ Ineffective use of 
captions 

3. Too long or too short 
for the topic 



4. Confusing 

5. Wordy, rainbling 

, ' ^ ' \ 

6. Awkward 

7. Inefficient organization 

8. Technical terms left 
^ undefined^ 

9. Too formal or too 
. informal 

10. Inconsistent 

11. Dialogue stilted 

12. Too many or too few 
examples 

13. Examples are distracting 
Comments : 



the following items by circling the 
Lnt scale. In addition, edit -and 

^ • ■ ■': ' ■ 

2 3 *4 5 Well cTrganized 

2X3 4 5 Effective use of 
captions 

2 3 4 5 Optimum length for the 
topic 



2. 
2 
2 
2 
2 



3 4 5 Cl^ar 

3 4 5 Brief, - conci^(^ , 

3*4 5 Fluent 

3 4 . Efficient i organization 

3 4 5 Technical terms defined 
' propyly ' ^ \. 

3 4 5 Suitable style 

3 4 5 Consistent 

'-^ , ' 
3 4 5' Dialogue fluent 

3 4 3 Approj)riate numbejt pf» 
examples " / 



2 3 4 5 ' Examples are useful and 
relevant 



Suggestions : 



/ 



Figure 3,? Questionnaire given to language fevieweys. 
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8. Active particijiatipn on the part of 'the. traitiees was increased, 

- ^ ■ - • ' \ 

9, '.' The amount of feedback ,given to^trainees was^ increased. 

10. In, sefveralJ of the modules . [e.g, , T^skj Analyses ) a preview, in 



tenns* c^a "teasajr," was added. 



1 



\ 



11,' The.amoiont of material for certain of the preins^ructiona^L com- 
petencies was so great that instruction was brokeii into smaller 



V. 



un 



it^o This is the rationale for having two module^, for task 



analysis and two for concept canalysis, 

j" 

12. Irrelevant content and activities we^e deleted. 



The difficulty level of. some of the learning activi'tie^ was 



simplified . 



A 



.14. Instruction on prerequisite skills and knowledge was adde^ ^ 
" (^-g*^ Classroom Charts , a ^ctioh on various media f or \ 

\ 

f '.. ' ■ ' ■ ^ N . 

^producing classroom charts wa,s included) , • \ ^ 

'15. The mechanics for some o£ the analysis atid design skills were\/ 

♦ - . \ 

' .simplified. , . \ ' ~ \ 

Production of Prototype . ' ' ^ ' 

^ Prototyjpes of the various modules were' produce i t:ie rare of 

approximately one every two months. ^ Audiorecording w: :.-ne. under t-he^ ' 

direction of -en audio director/ engTneer. All visuals ere shot on^55 mm 

^double frame slides under the supervision of both ne .ruct:ional I 



ion ha^i.capped children Fro:n the. Develc: 



developei* of given module and an instructional medi 
Darent pe^. 

■ientrr Blorin_ on, Indiana/ w«re used as child, 5 ib' 

..af. ^': :ia s :zz. j, teachdr-made materials, assort x 
pre per: ing in th^ modul^es were obtained fro 



i..ist. With ' 
L Training 
the modules, 
und other 

n-"^ ^-'^ere ' 
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Kkn<$^apped le^yners were receiving instruction • The captions ^or visuals 
#in me pVototype modules were typed _an^ cardboard and photographed on 
Ektacnrope tungsten film. The response books were prepared from mimeographed 
.steficils and bound in 8^ x format. . ■ 

Asseably '7 ' 

! W^en the editing of the audiotape was completed for each module, 



the 1»pe%a^; sulpaudibly pulsed for synchronizatioa_with the slides . The 



assemble^ prototype modules were j^epared for further expert appraisal 
.and lear?ierf.1ferification« : ' , . 

Format iye . E^liiation . ' # 

DuMng the formative evaluation phase, experts and available trainees 

were exposed to the various modules. ' 

- ^ ' ^ 

Expert Appraisal . Special education teacher trainers from Indiana 
Univet^ty, as well as froiu 16 other teacher-trainin Ions rc ur 



»the-United States reviewed^ the protot^l^ modules, 
\s ere distributed previously wepetSlso given t 
-idditi^n, anecdotal data were recorded from the e>: 
of their'' comments analyzed. Given below is a lis' 
:'eviewed the various podules: 
)r. Patricia Morrissey 



.sflc 



cont:ent 



\0 



Indiana Un; 
Bloomingtor 



ity 
diana 



Patj-icia Gillespie 
Kaith -Browpsmith 



Robert Ankney 



Indiana University 
Blooming ton, Indiana 

k 

Indiana University 
Bloomihgton , Jndiana 

Bowling Green Sl^o U:.iversit} 
Bowliffg Green, Ohio 



7 



h 
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Dr. Mona Ballard 



Dr. Bruce Baum 



Ms. Maria Bove 



Dr. Richardine Connellefe / ^ 



Dr. Rpbert Fowler 



Dr. Dorothy Howard 



Dr. Sue Kiniry 



Valparaiso University 
Valparaiso, Indira ^ 

^ State University CojLlege "at Buffalo 
Buffalo, New York 
■» 

College of St, Joseph the Provider 
Rutland, Vermont ' . ' 

Appalachian State University 
Boone,, North Carolina 

Universit^' of Florida . , 

G ires^ . Florida 



iver 
Le.infT 



v^f ken .icky 
\entu. 



ec 



Dr. James McLoughlin 
Dr. Ci^Tl Mangilun 

i 

Dr. Srantor^ Morfis 
Ms. Do lor6.s '^'Peters 



^ Dr^ Timothy Roberts 
Ms. Carole Stowitschek 



N|s . Wary |Thormann 



Nich : 
Thil: . 



jerr r 

St*. J 
Wes" 

3 ow ... 
Bow_ I. 



uisiai-u. 

Denve~ 

. radc 

Jo lie ^^e 
rd . Conne 

en Unl^^£r 
-2n, Oh-o 



at 



Georg P: _ioody College for Teachers 
Mashv-_li. Tennessee 

Mar^'moun Col lege 
A5:linr~ r Vijginra 



In addition to special education^t ea::her trainers, instructional de\ -Opers 
also reviewed the modules » Icentical q Eiesti9^.naires were distributed to 
these experts, Ipss the^ content que3ticnr. ai: j . Instructional developers 
participating in th^e reviews /ere: 
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Dr, Allan Sheppard 

/- 

Oi:.' James Russell 

.f 

Dr. Dennis Pett 

Dr. Kent Reavis , 

Dr. Gar'' 'lt^ ~* • 

^ 

FinL.^ly, r- auction spec:. 

9 

quality th . arious c^mpc* . 

the Div_ ncf instructional : 

were rec :ec appraise tb 

classf -..dvi.nced produttior. 

UtoduJ Ths checklists given 
th^s rtrierrs m order to assi: 



Fort Valley College 
Fort Valley, Georgia 

Purdue University 
Lafayette, Indidna 

Indiana University 
Bloomington, Indiana 

ft 

Southeast Vr'rginia Training Center 

for Ment.a.1 Retardation ' 
Che^peake irginia 

University or Mid-America ' * 
Lincoln , Nebraska ^ • 

_sts were ^sk3d\tc iassess the technical ' 

t^ . Faculty m:. ^-raduate students from 

- \ 

ems TechnoiD;," t Indiana University 

:otype mqduir:i Two complete graduate 

if 

:t nniques also eva^-uated the prototype 
.gure 3,8 zz I M J^were distributed! to 
.em in their appraisals o 



modul 



..back fr^ni all experts- used as the h^sis for revisions to the 



i^sarner iy8i;-ification . Tl-.e prototypes of each module w6re tested with^ i 

> ♦v ' • ' 

teacher trainees, practicing teachers, itinerant teachers, and consulting , 
teachers in a numb ei -of different settings using- a* variety of delivery system^, ^ 
The pi^rpose of the tryouts at this, stage was to gat^ipi?". information from members of 
the target population on how to improve the modulefs. As information was gathered 
from tr^iinees, revisions were made and the- revised -versions were retested with' 
n^w trainees, Figure 3,11 shows tJKe cycle of tryout and revision which was 
undertaken 'f6r\each module, Wb^ 'data indicated satisfactory results for , i 

a module^ f inal' adjustments were made and the module was moved to the final 
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r 



6ood Adequate Unacceptable 



\ 



1. Are VQices clear? 

2. Can every word be .understood? 

3. Are there distracting noises in 
the narration? ^. 

4. Are there tape noises? 

5. Can sub^udible- tx>nes be heard? 

6. ,Are audible ' tones clear? 

7. Is synchrod^ation ■ correct? 

' 8. Are there any script errors? 
'9. Can edit sounds *-be- heard? 

10. » Are voices credible?, 

11. Are pauses the right len^gth-? 

12. Do record and playback speeds 
match? , . ^ 

13. ' Is music appropriate? 

14. Is music well-integrated? 

15. Is-music level balanced with* 

narrator?^ • . 

V > 

16. f^Is there" sufficient, leader? - 




Rerecorjd /f^'odf fy / Retain 



. Figure 3,8 
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'Audi^* checklist. 



/ 



las 
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1. 

2., 

V 4. 



Is picuure in focus? , 

Is there sufficient depth of focus? 

Is exposure correct? 

Is the. lighling^orrect? ' ^ 

5. Is color balance correct? Is. 
color* 6^en? 

6. Ts the object of import^be 
prominent enough? ' \ 

* \ * 

'1. Are there distracting elements 'in 
the^picture? 

8. Are words legible,?v-L 

./ . ■ . , 

9. Does the picture match-the 
* ^ audio tracK? 

IQfi . Is pictun^ consistent with others? 

11. Is, the picture mounted strJ^ight? 



Good Adequate Unacceptable 



12. Is. $he -picture clean 



1 



7 ^ 



t 

. 


'9- 


' i X 




t 


I. 


i' 


1 i 






"Reshoat 


Modify 


Retain ^ 




v^Figli^e A cliecklist for visuals. 




* 













If . 



J 



■/ 
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• 1. 
"v 2. 

•5. 

-* 6.- 

9. 



10. 

0 



V - - 

-Orgajiizatien of the content. - 

Effective use of headings and 
subKeadiii^. ^ . ' 

9 / 

Validity of criterion questions. 



Good . 



Adequate 



Unacceptable ' 



Adequacy of sunnnaries and checklists, 
Style of writing. * , ^ 

Evideixce of proof/ reading. 
Ease of reference. 
Utility of references. 
Layout and format. 
Use of visuals. 




Retain 



Revis^e Be-do 



Figure 3.10 ^ checklist for evaluating the response booklet. >^ 



Mr 
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Table 3.1 



Developmental Testing |t ages 



4-^ 



Tjryout 
situatioi^ 



^ Initial 
- testing 



Individual teacher 
trainees or small 
groups in a face--^^""^ 
to-face situation 
with the instrOc-^ 
t~lonal developer 



Quan- 
titative, 
testing 



. Total- 
package 
^ testing 



In actual training" 
situation under 
the* direction of the 
instructional de- 
/veloper 




In actual training 
situations without 
the instri^tional 
developer 



Type o£ ^ 
students 



Selected teache:)^:^ 
trainees ^ ! , 



Te.3.'cher traineesi 
enrolled in a J 
caurse 



All teacher train- 
ees enrolled in 
a course 



Typ 



act^i-on^,, 
tea^he^^ t^^in^es 



Als^ r^^^orx^es to 



str^^^P^ ^%inents 
and ^ug^e^^ions 



Revisioft 



Some on -the- 
spo't , others 
after, each 
tryout sessio: 



Systematic 
revisions 
based on 
data analysis 



Revisions of 
instructor's 
manual and 
adjunct ma- 
terials 
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production stage and readied for field testing. Table 3,1 shows the various 
stages of learner verification and revision undertaken in this project, 
including the total package testing which is described later in this report. 
Table 3.2 shows the names of the sites where learner verification was con- 
ducted, the type of trainees, the number of trainees, the module that was 
used, and the type of delivery employed. 
Revision ^ 

Revision activities were* simultaneous with expert appraisal and learner 
verification of the prototype: As feedback was accumulated for a module, it 
was analyzed and revisions were prescribedo The production teams carried 
out the revisions made to each module, but they are far too numerous to list 
here* Instead, some of the major revisions carried out on each module 
component during the tryout and revision cyc|.e are listed in Table 3o3o 

Final Production e 

^ - ■ 

When the modules began eliciting favorable comments and consistent 
student performance, final production was initiated. The slides were 
converted to filmstrip^ The recording on audiotape was transferred to 
audipcassette. Synchronization of the audio to the filmstrip was redone and 
verified. The response book was printed in offset in a convenient 6" x 9*' 
format. Finally, a package to contain all the components of the module was 
designed and producedp The resulting final versions of all the modules were 
ready for field ev^uation^ 
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Preinstructional 
competencies 
module 



4- 



Learner 
tryout 




Proceed to 
summative 
V evaluation 



Implement 
revisions 



Prescribe suitable 
revisions 



IK 



Identify probable 
causes of problems 



Figure 3.11 Sequence of learner verificationt-and revision activities. 
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, Table 3.2 
Learner Verification Sites 





AUDIENCE 


N 


MODULE USED 


TYPE OF DELIVERY 


ofiington, Indiana 


' ' tJildeWradu^e 

Sp'eclal Education 
^ teacher trainees 


20 


Task Analysis 


Large group / 

7 ^' 


nington, Indiana 


Undergraduate 
Special Education 
teacher trainees 


20 


' Lesson Planning Through 
Task Analysis ^ 


Large group and / 
individual ^ / 

. / 

Individual and pair 


3nMVoods, Massachusetts 


/ 

Pr'^cticing- teachers ai)d 
consultants in Special 
Education 


17 


Instructional Gaii^s 


3n Woods, Massachusetts 

/ 
/ 

/, 


Practicing ^'teachers and 
consultants in Special 
Education 


18' 


Preparing Tutoring 
Materials 


Individual and pair 


rst, Massachusetts 


Special Education 
teachers and L.R.C. 
workers 


6 . 


Concept Analysis 


Individual 


dngton, Ihdiana 


Special Education 
undergraduates 


26^ 


Concept Analysis 


. Large group 


lington^ Indiana 

! '■ 


Special Education 
undergraduates 


32 


. Planning a Concept 
Lesson 


Large group 


ta-, Georgia 


Special Education 
undergraduates 


23 


Instructional Games 


Jndividual 


lie, North Carolina 


Practicing teachers 
in Special Education 


. 16 


instructional Games 


Individual , 


lington, Indiana 


Special Education 
undergraduates , 


40 


Selecting a Curriculum 
Package 


Individuak smalL ^oup 
and large gloup 

113- , 


[2' - 

0 
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» • , Table 3.2 

' Continued 



.... ^ 


AUDIENCE y ^ 


■N 


MODULE USED 


' TYPE OF DELIVERY 


LTis Lake, Michigan '■ ' ' 


Itinerant jt^achers of. 
Special E(^caticn 

. 'rf ' ■ / 


34 


Specifying Behavioral 
Objectives ^ 


f 

Large 'group and small 
group- 


)rd, Mic' ^an 


Practicing teacher in 
Special/ Educa:^ 


24 


Specifying Behavioral 
Objectives 


Large group and small 
group 


speg, \^ )a ' - 


Practicing te; 
■Spec/al fduc .L_ 


22 


Classroom Charts for 
Handicapped Children 


t 

Large group and pairs 


jpegi Manitoba 


Graduate Stuc^nts 


10 


Classroom Charts for 
Handicapped Children 


Individual v 


)daux, ..ouisiana 


^ ^^ndergraduat and 
/graduate st ; nts 
in Special cation 


51 


Classroom Graphics for 
Handicapped Children 


Individual 


lu, Alaska 


Practicing ichers in' 
Special Edu:a'^:ion 




Preparing .Tutoring 
Materials, Instructional 
Games 


u 

Individual, pairs, and - 
small groups 


angton, Indiana i' 

/■ 


Undergraduate Special 
Education teacher 
trainees 

■ ' i 




Teacher-Made Reading 
Materials 


Individuals _ • ' 




■ ■ '/ 
■ ■ 








• ' * 'J 


■ 1 

■ ■ . 1 

1 

( 
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' " Table 3.3 

riajor Revi' ior M .e tv ' 
\ . ■ Forma ivt r uatio- 



RESPONSE. BOOK ■ 



Ar 



During "^^^ 
.fcle 



VISUALS 



Series of graded exercis s 
included '.at the-'end of tne 
rbspoi^se book.;' 

Sample/task analyses 
changed* to niQre relev^t 
topics for teachers of 
handicapped children. 

Samples of correctly done 
task analyses put in right 
after bach question for 
iiflmediate feedback. 



.roductory^' tea i\ 
jed. ' \- 



It. ig tead:er*s 
changed. , • 



aiation of 
iqni I uses fc 
ana. /sis in- 
A. . 

3ack 3n task 
ysis exercise) 
ved. 



L New set or . shot fox 

'opening tc ^quence. ^ 



2. All tasjc shot from 

cards^' re^ ^ gre^-:e^ 

legilJilif 



3. Final vis in 
final exe 



4. Captions -aon. vai 
type.. Cc.or ot 

^ captions added. 

5. Tas' anal^/^ ■ exercLses-^ 
f ..back v^s^rials deleted 



i J. < 
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3. Number ,r ^t^: 

increas jii to : :J 
' transfer ■ ■ p nr 



Cc:*:tinu 



4 



Ir.j 



RESP.ONS:;: s i ' m- ' wsuals , ' .• 



n. 



A ' , Sen. ^\.u dnr ' \ 1:' ^Th^os^e close-ups of the p^an 

Analysis, ' inc. ' .^bpok 'which were unclear 

' I ' ' resr ' reshot. 'S* ' • " ' ; 

• '|^\ *'2-. '^Ii. :• .in: . . 2. ' Shots^pf children deleted. 



re " at? 

cl^ i : . 



;:;ral a ■ n ; ty 
^he ta]. --d 



/ 



"■6 
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^T^le 3.3 



' 0 















• '■,.\. 













RESPONSE BOOK 
^ 



AUDI^ 



VISUALS' 



ysis 



1. Number of exiles j.n- 
' .creased from one to' 

three. ^ / ' z^-- 

2. More divergent; examples 
provided (one" concept, one 

, common language ponqept^ 
• , and one math con'cept) . 



'One of the examples 
presented in a con- 
tinuous form instead 
of in piecemeal 
fashi-on. 



The introduction 
revi^^d to a l^ss 
-'offensive" joke.' 



2. 



Narrator changed at the 
end ;of,. each objective 
to permit a change of 
pace. 



3. Informative feedback 
" included^on some of 
• the student ^signments. 



^1. Several errors corrected . - 
among examples' of s'quares. 1/ 



2. Slides showii)g such exaSnp^l^s 
as a bird above a building^' 
and^a basketball below the ' 

^ hoop replaced with clearer 
illustrations. 

3. New introductory sequence 
re shot. 

• "/ • ■ > ■ 

/ 

4. More slides added to illus- " 
trate the concept of matched 
nonpxampl^^s. , 



4 U 



1 



r. 



10 
10 
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Table 3.3 
Continued 



RESPONSE BOOK 



AUDIO 



VISUALS 



oncept 



1. Question format for each 
of the seven steps of 
the proce'dure. 

2. Three review questions . 
added to integrate the 
entire procedure. 



More de'tails for .the 
final, transfer assign- 
ment specified. 



1. Pauses between 
scenes lengthened. 



2. Model lessou changed 
to the dramatic 

^ \ dialogue format from 
the original narra- 
tion format. 



4^ 



1. Numb e^ of captions to / 
jemphasize the steps of the 

, procedure increased. 

2. Classroom shots shelving the 
teacher using the seven-step 
procedure included. 



3. The ffequencv of slide 
c)ianges nearxthe end 
reduced. ^ 



Table 3.5 
Continued 



RESPONSE BOOK 



All activities not 
related to game 
modification and 
adaptation eliminated. 



Details of Shapes 
rewritten to make 
adaptation easier for 
the trainee. 

A list of sources of 
games included. 



AUDIO 



/ 



2. 



3. 



4. 



An initial segment 
involving interviews 
with twelve handicapped 
children replaced 
with an interview of 
their teacher. 

Descriptions of twelve- 
modifications *of the 
Sha pes game expanded. 



Descriptions of twelve, 
modifications of the 
Shapes reduced in length- 



VISUALS 



1.. The introductory interview 
section entirely reshbt. 



More visuals added 
for the( Shapes game. 



teacher shots replaced 
by phxjtographs of game 
materials, | 



Merits of games for 4, 
handicapped children made 
in one^alient. 



More close-up shots 
of game artifacts and 
children at play included. 



I 
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Table 3.3 
Continued 



RESPONSE BOOK 



• AUDIO 



VISUALS 



1. Section comparing ' 
..different duplicating 
^ procedures added. 



A basic vocabulary, list of 
^220 words provided for use 
by teachers. 



The number of sfainples of 
teacher-made stories increased 
and made more divergent 
across* different age 
.levels. 



Initial dialogue 
introducing the 
rational^ for teach- 
er-made reading 
materials consid- 
erably shortened. 

Instructions to stop 
the tape at the end * 
of each step replaced 
by two stopping . 
points. 

Expository narration 
of the procedure 
changed to a dialogue 
between two teachers. 



2. 



3. 



All liv6 shots redone to 
increase clarity. 



Shots with both indoor 
lighfing and sunlight 
reshot with a 10% 
magenta filter to increase 
warmth. 

The entire teacher dialogue 
sequence redone with a more 
appropriate male model. 



4. Benefits of teacher- 
made reading materials 
for handicapped learners 
more frequently mentioned. 



c.n 
CO 
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Table 3.3 
Continued 



r 



RESPONSE BOOK 



— s 

AUDIO 



^VISUALS > 



1. The contenJt of the 
module expanded from 
experience activity . 
charts to cover all 
types of classroom 

: ' charts. ^ 

2. More material on the 
proper use of classroom 
charts included. 



3. An additional transfer 
ex^^fcise intluded ^t 
tho end of the response 
book. 

4, ^The entire sevenrstep pro- 

cedure included in the 
response book. 



1. 



2. 



3. 



4. 



The narrator changed , . L 
because of lack of 
clarity, 



Thi dialogue for the ' 2. 
teaser segment 
entirely eliminated 
and replaced by musi?. 

The amount of repe- 3. 
tition increased to 
emphasize key concepts. 



Learner- ini ti ated 4 . 

activity^arts given 
greater importance. 



A rapid-^fire sequeace of 
divergent samples of class- 
room charts added to the 
beginning of the module. 



Examples of classroom^arts 
edited and resequenpd to 
accommodate more, diverse 
media. 

Samples of charts not rele- 
vant to the handicapped pop- 
ulation eliminated. 



The visuals for the seven- 
step procedure reduced to 
accommodate response book 
changes'. 
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Table 3.3 
Continued 



RESPONSE BOOK 



AUDIO 



VISUALS 



1. AU exercises not 
directly related 

to the coinpetejicies 
specified in the 
objectives eliminated. 

2. Graphic exercise in- 
structions changed frc^ 
narrative form to a 

1, 2, 3 form. 

\ ' ■ 

3. All additi^al source 
information on graphics 
eliminated. 



1. More frequent' 
change of narrator 
made. 



2, A new narrator 
selected to sound 
more like an older, 
experienced person. 

_3, Music introduced during 
the tour of the' school 
segment. 



1. Increased close-ups of 
classroorai visuals added. 



2. Captions (Teshot using 
colored backgrounds.' 



'3! Transitional, slides incor- 
. ' porated l^etween^e various 
units. 
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I \ Table 3.3 

i Continued 



RESPONSE BOOK 



AUDIO 



/ 



VISUALS 



Test items dealing with 
background theory elim- 
inated. 

An exercise which simulated 
tutoring added to the 
front before actual design 
assignments were 
presented. 

The number of exam examples 
of tutoraids increased from 
one to three. 



4. llie tutoi*aid flowcharts ^ 
redone in l^avy black to 
increase s'ajiency. 



3. 



A. All introductoif 
theory elij(linated. 



More frequent exercises 
inserted in the tape-w 



3. Pauses for trainees ^to 
covertly ifespi^d to 
questions lengthened. . 

4, Relationship of visuals 
to handicapped learners* 
needs given increased 
emphasis oji the intro-^ 
duction. 



^ — 7 

1. BackgrdLinds ?8|^tutdraid 
flowcharts changed to 
increase contrast and make 
them^more readable. 



Full flowcharts and arrows 
replaced by close-ups of 
sections of flowcharts. 



3. Actual tutoring materials 
^hown more frequently. . ( 



■ .r 



CHAPTER 4 



i * • ■ • TOTAL PACKAGE EVALUATION 
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In .this section, the evaluation of the set of preinstruotional competencies 
. modules as a total package is described, A rationale for this type of eval- 
uation is given. Following the rational^ the evaluation design' is described 

■ ' , . ' ^' ^ . . ; . ■ • 

along with the instruments and materials. This section also contains a 
detailed description of the evaluative procedure. Finally, results of the 
total -package evaluation are discussed. * 
Rationale j < 

The decision to conduct a total package evaluation in which all the 
modules in the preinstructional competencies series/were tested was based 
on the following rationale: - 

1. The modules -were designed a? a complete course and therefore 
should be tested as a complete course J As stated in the original proposal 
for the project, emphasis in the training of teac^Mfcrs Qf the handicapped 
has traditionally stressed the rale of the teacher in interactive settings 
rather than in planning situations^. What little training he/she receives in 
planning and man^igement skills is usually acquired in piecemeal fashion. / This 
series of modules had as its primary design objective the provision of *'a 
systematic approach to training t|ie teacher on .the preinjStructional competencies.,/' 
Evaluation of the effectiveness of this objective, requires testing all the 
modules in a total package setting. ' 

2, The design modules are .based on the analysis modules . The first 
five modules provide the trainee with skills in stating behavioral objectives, 
performing task and concept analyses, and preparing lesson plans. The design 
modules require trainees to produce materials for the lessons they have 
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plained for handicapped learners. These materials should contain specif ifc 
objectives' and be integral- parts of systematically derived and planned 

' • ' - ' ; y ' 

lessons. Unless tke analyses and de-sign modules are all provided ta 
ti'ainees in their proper sequence, the instructional effectiveness of the . 
combination cannot be assessed ^s a means of providing a complex of skills. «• 

. 5. -A total p;acKage evaluation is required in order to measure the 
attitudinal impact of acquiririg all preinstructional competencies . At t i t udes^ 

. ■ ^ 7 

tward individual preinstructional ^competencies may vary with the previous 
skills that the subjects possess and^'the appeal of ^jiarticular type of 
analysis or design. Teachers , however , require a number of skills in order 
to adequately prepare lessons and materials for their handicapped pupils. >^ 
It'is not a favorable or unfavorable attitudJ toward one skill that determnes 
whether a teacher will employ a systematic approach to his/her teaching. 
It is^an attitude to the entire range of competencies required before 
instruction actually takes place. Assessment of this total attitude can only 
^be carried out when trainees are exposed to the complete series of modules 

4, A tol;al package evaluation is required in order to measure attainment 
of a tot al set of preinstructional competencies . Just as with attitudes, 
attainment of one or two preinstructional competencies does not guarantee 
that trainees have acquired a sufficient set of competencies for systematic 
planning of their instruction. By providing Wainees. with the entire series 
of modules and assessing tlieir total competencies, more information is made 
available for determining the interrelationships ainong competencies, 

5., Accumul ating data on all the modules enables us to make comparisons 
among them. Individual modules are bound to have differential effects in terms 
of competency acquisition, attitudinal impact and appeal. By presenting the 

\ 
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same group of stibjecjts with all the modules in the series, ^e are able to 

• ■ . • ■ ' ■ ' ^ ■ ' • ■ 

^raake comparisons among the modules pn a wide range of variables. This 
provides us with a base for determining causes of variability of etfects . 
among the different modules. , 

6. Data analysis is simplified through a total package evaluation . 

A few of the major problems in any evaluation of data are; keeping track of 
the data, assuring comparability of effects, and determining the homogeneity 
of subj ect^^ groups . By employing fixed groups of subjects for al 1 ..modules , 
analysis of the effects of, the individual modules is simplified. This 
increase's the efficiency of data collection . 

7. Earlier evaluations of individual modules indicated a desire on the 
.* ' * 

part of.both trainees and trainers for a more coherent instruction as opposed 
to -^'one-shot^* deals . In testing indivi4ual modules under field cc^nditions, 
a recurrent ' theme in follow-up discussions with both trainers and trainees 
was the. lack of closure in working through a single module^ The implica- 
tion was that this form of working through a module was too 'piecemeal/* 
It was suggested that modules which are coherently related to each other- 
shothld be tested tajgether^in a situation where working through the modules 
was integrated into a meaningful program. / . ^ 

8. Through repeated use of the audip-visual training module, the novelty 
effect of th^.s format is reduced . Time and again, a true reading of the 
eVf^cts of an innovative system. is distorted. by the novelty effect of the 
system. Virtually all special education courses , other than the practicum 
variety,, involve the traditional lecture and textbook. Bringing an audio- 
visual training module into such a setting can be. extremely reactive. However, 
in a course which entirely consists of an individualized audio-visual format 
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spread- out over a semester, the novelty effect soon wears out* TTiis permitsV 

I 

the assessment of the effectiveness of the modules apart from their novelty. ' 

9, Through repeated use of the aud io-visual training modules^ the 
fatigue effect of this self -gnstructional format can be assessed . Just as 
novelty can distort the effects of a self-instructional audio-visual train- 
ing module, so too can the fatigue effect influence resul^l. As more and 
more special education teacher-training progranvs go to cbmpetency-based and 
individualiy^ed instructioi^, greater demands for self-instructional modules 



are made. Can a pre-service or inservice te^acher take m entire course 
whicb is self-instructional in nature? Through .a total package testing, 
this question can be answered. 

10. Previous evaluations of modules produced^by the Center ^for Innova- 
tion in Teaching ^ne Handicapped (CITH) have_ always bden done on individual- 
modules , In previously funded projects, CITH- has carried out systematic ' 
evaluation of either individual modules or pairs of modules to evaluate the 
effectiveness on a number of criteria, Total package evaluation can ^^d ^ 
relevant information on the cumulative effects of a number of modules and 

the viability of such an approach to evaluation. 

11. A total package evaluation provides useful information for novice 
instructors who are seeking to implement the series . Many of the preinstruc- 
tional competencies, contain concepts and principles^ that are unfamiliar to 
special education teacher trainers who nevertheless regard these ^alytic 
and planning skills as essential for the modem teacher of the handicapped. 
Those who are interested in utilizing the series of modules as the basis for 
a course require data on the total effect. 
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12, A total package evaluation is cost -ef fective ■ Where a number of 
instructional materials are designed and require field testing, the cost 
of identifying and establishing numerous sites, as well as preparing in- 
structors for evaluation through visits and telephone communications, 
becomes extremely high. By evaluating the modules in a real course setting 
wherein the modii^les in the spries are tested at the same site, cost 
savings accrue without loss of useful and usable, data for a siammative 
evaluation . ' , ^ 

13. Enthusiastic urgings from the field to test the entire series and 
a number of offers to "run a course" based on the m'odule series indicated a 
need to conduct a total package evaluation . Teacher trainers in special 
education as well as consulting teachers, and other special educators who 
visited the center and learned of the series of modules on preinstruct ional 
competencies, demonstrated eagerness to tiy out the entire package. More 
than twenty unsbllicited requests encouraged the Center to take this approach. 

To summarize, a number of factors recommended total-package testing 

as the most appropriate approach to the summative evaluation of ,the series 

of modules. In the initial proposal, the g^i^ral objective for the project 

.was stated thus: ^ 

Upon completion of the entire program, the teacher shall be . ) 
able to demonstrate the following competencies: ■ ^ 

Task analysis . Identify units and lessons and analyze them into 
component tasks and concepts to be acquired by the handicapped 
child. • 

Specification of objectives . State and sequence a set of behavioral 
objectives for an individual child. 

Designing instructional materials . Design learning games, programmed 
units, transparencies, etc. to supplement existing materials. 
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Lesson p lanning . Plan for the systematic integration of behavioral 
> objectives, criterion-test items, instructional materials, and 
interactive strategies. 

Designing learning environments > Plan and design appropriate 
enviroliments to enhance desired learning outcomes, 

i 

To evaluate whether trainees acquire al 1 these competencies as initially pro- 
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posed, a total package evaluation was , undertaken as the final activity of the 
project. 
Design 

In order to carry out a total package evaluation that would have 
meaning to consumers of the modules, the evaluation team decided to carry 
out their final testing of the modules under actual field conditions . A 
complete ^Tiands-of f evaluation procedure was designed in order t^o 
eliminate the contaminating presence of the Center staff. 
Performance ' ^ ' . 

Because of the specialized nature of the content of the modules^ the 
evaluators decided not to administer any performance pret;ests. This de- 
cision was based on discussions held with instructors from special ^education 
teacher-training programs who 'indicated that questions related to such 
topics as task analysis, concept analysis, or classroom charts would be mean- 
ingless to their students. To confirm /this, during formative evaluation. 



several pretests 'on randomly chosen modules from the preinstructional 
series were administered to undergraduate students enrolled in special 
education courses. Low results plus extremely negative reactions to questions 
asking, for example, that a trainee specify close-in nonexamples of a 
'concept in which the most salient critical attribute was missing, or make the 
optimal choice between grid and non-grid scaling, confirmed the evaluators' 
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decision not to collect pretest data. Hence , the design basically involved 
a posttest-only paradigm with a criterion-referenced posttest designed to 
directly measure the attainment of the objectives for each module. No 
control groups were employed. In terms of the performance evaluation, the 
design can be illustrated thus: 



- - « — — — — ■ 

where X is the modular treatment and 0 is the criterion-referenced posttest 

/ '• 

f ' * 

immediately following the use of the module. 

Attitude 

4 

Two major attitudinal variables were involved in this total package 
evaluatioYi: 

1, Attitude toward the content of each module, 

2^ Attitude towaril the self-instructional format. " . , 

The evaluators decided to". collect pr-^^:^ data on subjects V attitudes toward 
the content of each module because the isidered that, although trainees 
mighVnot be able to demonstrate any of the preins tructional competencies 
specified in the modules, ^ey might still have either heard or read about 
them in classes. They wer^ ^also 'concerned with discovering whether the 
modules had any negative effects in alienating trainees by what might appear 
to.be complex or unnecessary competencies. Finally, they also wished to 
investigate whether more neg,^tive attitudes developed as the. novelty effect 
wore off and the fatigue effect set -n. ' , 

The design called for the collection of pretest data on attitudes 
toward the content of each module and toward self-instruction prior to 
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/ ■ 
discussion of any of the topics or the use of tha series. On completion 

of the entire set of modules, attitude posttests were administered. 

Instruments 

A series of performance tests and attitude scales Were prepared to 
determine the extent of acquisition of compdftencies and of changes in attitudes 
of the subjects as a result of working th^pbtigh the modules. These instru- 

/ y ■ ■ 

ments consisted of applyed performance tests and attitude scales. In 
addition, instructor comments as an "expert" appraisal mechanism were also 
collected. 

Applied performance tests . For each module, an applied performance 
test was designed to directly measure^ the attainment of the main objective. On 
the basis of a systematic task analysis .of the topic, objectives for each 
module^ere derived to match each of the main objectives.. Domain-referenced 
items were constructed. These items formed the basis of the applied per- 
formance test;. Each performance test item was built into the response 
book of eath module. The item required the synthesis and application of 
all the componen iiipetencies treated in the module. In each case, the^ 

of his/her ovm choice . 
and appi: lIioso skills he/she had just acquired as a result of working through 
the module., A systematic scoring k^y was designed for e'ach applied per- 
formance test to measure a^comes in terms of the minimal standards spec- 
ified in the training objectives for the module. 

In order to facilitate scoring and also provide meaningful feedback 
to the subjects, a five-point scale was utilized by the instructor on each 



trainee w juired to select a cu^ricular topic 



of th ct characteristics contained in the scoring key. The performance 

test was used in the context of a mastery- learning format. As far as the 
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subjects were concerned, they could improve their scores by redoing the 
performance testy tasks and resubmitting their products for a second rating. 
The entire set of performance tests are included in Chapter 5. 

4 

Attitude scales . To measure the attitudes of subjects toward the content 
of each module and toward the self-instructional format, a set of 17 bi-polar 
terms were derived from previous field tests on individual modules (Braffet,' 
'1976; Stolovitch, 1975'; Thiagarajan, Semmel 5 Semmel, 1974). These 17 .terms 
were used as the "standard set of items oh all of the attitude scales. This 
particular format was chosen by the evaluation team because of its ease of 
administration and scoring as well as its relative non-reactivity. Con- 
sidering tlie length of each treatment (e.g., the module oa Classroom Graphics 
for the Handicapped along with the performance exercises requires from 2h 
to 4 hours) , it was deemed critical that instruments be as brief as possible 
so not to overload the subject. The same bi-polar terms were preserved 
in all the attitude scales because previous studies on widely divergent 
individual modules had demonstrated their reliability. The use of a con- 
staxit set of terms also permitted comparisons to be- made among all modules 
^d facilitated pinpointing common positive and negative attitudinal features 
across modules. These terms also made it easier for the subjects to respond 
reliably and consistently. The 17 bi-polar items are shown in Figure 4.1. 

Instructor comments. As an unobtrusive and informal measure of the 
usability and feasibility of the total package, instructor comments and 
complaints were recorded. Instructors were provided with a toll-free 
telephone number and asked to communicate with the evaluators any time a^ 
crisis arose . 



ERIC 



115 



FIELD SITE: 
MODULE.- — 



t 



r 



r 



PHE-T^ST MEDIAN: 

I 2 



POST-TEST, MEDIAN: 



UNPLEASANT 
USELESS 
DULL f 
WEAK 

INEFFECTIVE 

UNCLEAR 

IRRELEVANT 

iDEALiSTIC 

NOT PERSONALLY 
HELPFUL 

INAPPROPRIATE 

NOT BENEFICIAL 
TRADITIONAL , 
UNIMPORTANT 
BORING 

TICIENT 
COSTLY 
VALUELESS 




-h- 



4-- 



V 



Fig. 4.1. ^ Attitud'ef scales, 



1 AQ 



PLEASANT 



USEFUL , 
^ STIMULATING 
«l POWERFUL 
H EFFECTIVE 



^ RELEVANT 



_j I PRACTICAL 

PERSONALLY 
_, , . HELPFUL 

I APPROPRIATE 

_, ^ BENEFICIAL 

I ^ //? ^tlESTING 



H EFFICIENT 
-I INEXPENSIVE 



4 VALUABLE 
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In addition, instructors were requested to record their obsi&rvations of any 



of the weaknesses of any modules. 

^ 

/ ! ■ 

Materiq/ls / ' 

All subjects were required to work through the following materials: - 

1. Nine audio-visual training modules consisting of an audiocassette, 
a filmstrip and a response book on the following topics: ' 

Concept Analysis 
Planning a Concept Lesspn 

Task Analysis - * - 

Lesson Planning Through Task Analysis • '% - ^ 

Instructional Games for Handicapped Children 

Teacher-Made Reading Materials for the Handicapped 

•k . f , * ■* 

Classroom Charts\for Handicapped Children* 
Classroom Graphics^ fo:Q|rHandi capped Children 
Designing Tutoring Materials ^-^^ 

r 

2. One interactive package on specifying behavioral objectives with a 
series of participatory group assignments. Subjects also were provided with: 

^ a. Singer Grafle^ Auto-Vance II audio-vjsr-" machines v ith automati 
synchronization . ^ - . 

b. Two copies of each of the modules response books (one to be 
turned in and the other to be retained by the subject). 

Procedure - ^ ^ 

Based on the total package evaluation design, the following procedure 

was instituted: 
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1. From a pool of twenty-three offers from v^ious special educatic 
teachor-training institutions, two sites were selected to represent typical ^ 
training programs for Reaching of the handicapped. The two chosen sites 
were The College of St. Joseph'the Provider, Rutland, Vermont, and Nicholl^ 
State University, Thibodaux, Louisiana. St. Joseph the Pro;^ider has a strong 
commitment to competency -based teacher traij^^g and was searching for 
materials and modules for their special education program. Niftholls • State 
University has only recently become aware of the competency -based movement 
and was uncertain aboi\t using mediate ins tioictional modules as hieans qf • 
providing the core of a course to th- ir trainees. IVhereas St. Joseph re- 
presented institution^^ actively conci me^^^ith developing a jfSreitistructional 
competencies course using the audio- visual module series , Nicholls State 
represented ^those institutions which were curious, but still tent^^"^' 

2. One special education faculty member i . jm each of the institv.cions 
came to the Center for Innovation in Teaching the Handicapped. 

they underwent three days, of inton- ive training on li. /rbcedurc. or the 
total package evaluation. These three days were designed not only to fa- 
miliarize the instructors with the 'modules and the evaluation design, ^ut 
a|^sj> to elicit from them many of the details for actually carrying out the 
evaluation at their respective sites. Hence, th\ three-day session was 
devoted both to .training pf the instructors and also collaboratively planning 
with the evaluators as tc^ how the evaluation of t)^e total |)ackage would 
proceed. Here in brief iV,^^how the three days ^re structured: 

a. The instructors f amiliari^d themselves with the modules by 
working through all of them. ^ \^ 
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b. Instructprs obtained clarification of the content of the 

s ^ f 

modules whenever necessary. • .4 ^ - ^ 

c. Instructors provided formative suggestions for impro^v^g the 
modules . ' v 

d. Evaluators' and the instructors collaboratively drew up a specific 
plan for conducting, the evaluating- This plan ^^ntained specifications for 
collecting data, handing out materials, sequeijiCing the modules, providing 

feedback, communicating, grading of students, and^c'oding tests and scales. 

/ . ^ 

/ e. Instructors participated with evaluators in collaboratively 

^ . . - . ' (N 

designing the testing instruments. 

^ f» Evaluators and instructors collaboratively drew up a time line* 

and set ot .duics for ' lomenting the plan with trainees, 

* .1 

3. T]-^ '-^strur-f- ( Institutions and organized the 
i nrses. i /olved: 

a. Obtaining departmental approval to run the courses. The two 
instructors conducted demonstrations of the modules at departmental meetings. 

b. Explaining to colleagues what the course contained and how it 
woifl^^be run. The primly purpose for this was to g^in cooperation of faculty 
.members as well as to elicit support for enrolling students in the course. 

c. Setting up the physical arrangements for running the course. 

I 

This included obtaining space to set up the audio-visual machines, storage 
space for securing^ the modules and equipment, and a work area for st4idents to 
complete exercises and tests. ■ ' . 

4. All the modules and machines were packaged and distributed to the 
field sites . ^ ^ * 

5. Actual implementation of the modules was initiated at each site. 
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a\ Attitude scales were administered to all the enrolled students. 
There was an attitude scale on each module and an additional one on self- 
instructional materials. 

b. Instructors informed students that the course was entirely based 
on the preinstructional competencies modules. An outline of the course was 
given, and the procedures and the grading system was described. 

c. The interactive package on Specifying Behavioral Objectives was 
introduced. Subjects played the behavioral objectives games. 

d. Subjects took the performance tests. 

f e. Sub jects^umed in their performance tests for grading and 

\ . ' 
feedback . ! / . 

f. Each of the subjects: 

1. - • , 

i. worked through the first module making responses directly 

in tlie response books. 
^ ii . took the performance tests incorporated in the response^ books . 

iii. turned in the pe^^rmance^ests_ for grading and feedback. 
' iv. received feedback from \he instructor and either made revi- 
sions or went 'on to the next module. Subjects received a fresh 
personal copy of the response book which they could retain permanently 
after turning in |their used copy. \ 

V. repeated' the cycle with a new module until all nine modules 
were completed. 

Figure 4.2 graphically illustrates the* procedure subjects followed during 
the total package evaluation. 

6. Instructors processed the data obtained from the applied performance 
tests. This entailed: 

a. Rating the final product from the applied performance test 
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using the appropriate scoring keys, 

b.' Recording the ratings and sending^these on to the evaluators 
at CITH. ,1 

'% c. Giving feedback to the subjects so that they couJd ivhh'^« t"* •••• 

to the next module or make revisions on the final product resulting fxom the 

0 

applied performance test, 
V 7". Instructors administered posttest attitude scales and coded these, 

8. Instructors mailed all attitude .scales , performance, tests and their 
own commentj^s to CITH.' 

9, Evaluators at CITH coded and analyzed th6 data. 



-1 ' 



/ 



1 



> 



I 



ERIC 



/ 



Begin 



Kovise pe3f- 

formance 
test product 



Enroll in 
course 



Complete pretest 
attitude scales 



Receive in format ion and 
outline of course 



Work through interactive package on 
Specifying Behavioral Objectives 



Yes 



Takg performance test ^ 



Turn in performance 
and receive feedback 




Is there 
^an audio -visuasl^ 
module ^to work/ 
through y 



Yes 



Work through 
audio-visual . 

module 



no 



Complete posttest 
attitude scales 



End 



Figure 4.2 Procedur^ for, subj ects during total package e^-aluation. " 
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CHAPTER S 
' RESULTS 

vin this section, results of the total -package evaluation are presented 
and discussed. In general, there are three- major categories' of results 
related to this evaluation: 

1. Trainees' attainment of preinstructional competencies as measured 
by applied performance tests based on the, obj ectives ' for each 
module. ' 

2. Qianges in traihees ' attitudes tov^ard the ccntort of the individual 
modules as measured by-s^^antic^dif ferential scales. ^ 

3. Changes in traineer.' attitudes toWrd the self -instructional 
firij.at of the modules as measured/by a semantic dif::»a ential scale. 



Each of th^e categories of results are presented and discussed below: 

\ ■ , ' * \ - ' 

Gains iV Preinstructional Competencies . Immediat ely aftej-. completing 

each module^ in -the pre ji. : luctional competencies series, the teacher 

trainee was ^ven^ an^applied. performance test'^ Requiring -a transfer of the 

<goi^etenci^s ^ Tha^equirements of these De^rforiifknee . ' 

tests are Wicated in Figure 5.1. Each performaftce test 'rfeiqiiired the 

production of some concrete product which was then evaluated by the / ' 

Mstnactor of the course with the help of a checklist: The applied" 

performance test was not a timed test; trainees were pemitted to spends - 

^ ■ ^ . 

as much time as they wanted on each project, wi-thin the constraints of 
the course schedule. Some of the later modules required the trainee to 
design, evaluate and modify fairly" elaborate instructional materials: 
these activities reportedly required as mucjh .as eight hours. „ \ 

" The checklists fqr« evalua:ting each performance test contained a 
number of appropriate criteria arranged in the form of five-point scales. 



MODULE 



APPLIED PERFORMANCE TEST 



1. Concept analysis 



2 . Task analysis 



3. Planning a con- 
cept lesson 



4. . Lesson planning 
through task 
analysis 



5. Designing tutoring 
materials 

6. Teacher-macje 
reading materials 

7. Classroom graphics 

4 



Choose a concept and report the results of a com- 
plete analysis in terms of critical and variable 
attributes, divergent examples, and matdfcd non- 
examples . * 

Choose* an instructional task and report the results 
of a complete analysis in terms of a hierarchy of 
necessary and sufficient subtasks. 

Prepsflre a lesson plan on the basis of the concept 
analysis and indicate the sequence* of teacher be- 
haviors, student responses, examples and nonexamples 
to be, used, and evaluation plans. 

Prepare a lesson plan on the ^asis of the task 
analysis and iil^icate the sequence of objectives, 
teacher and pupil activities, suitable instructional 
materials and evaluation plans. ' 

Design, evaluate and revise a complete kit of tutoring 
materials on a topic of your 0wn choice. 

Design, evaluate and revise teacher-made reading 
materials at three different reading levels. 

Design a classropm poster for use with handicapped 
children. ^-'^ 



8. Classroom charts 

9. Instructional 
games 



Design a classroom chart for use in a lesson of 
your own^ cho ice . 

Adapt a given game to teach a new instructional 
objective to handicapped children. 



Fig- 5.1'^ Applied performance tests for different modules in the 
total package evaluation. 
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The mean score for each test is the mean of the trainees' scares on these 
five-point scales. The mean and standard deviations for trainee performance, 
as^ell as the combined means, on each of the nine applied performance tefsts 
are given in Table 5.1 for teacher trainees in Rutland, Vermont, and * 
Thibodaux, Louisiana, field sites. The ratings are criterion-based and 
may be roughly translated to indicate the following levels of performance: 

\ adequate 

f 2 acceptable ' - 

3 — fair . ^ 

4 good , 

' ''\ . . * ' - ' ' y 

> . 5*-- exceptional . * 
y The' com^ned-means column of the tabl^e reveals 'that "the majority* cf, 
the modules have resulted in goo d performance while two modules produced 
fair, performances . ijie range of the mean scores is between 3.8 and 4.4. 

* 'Results from th^Rutlafid, Verin6nt, fi^eld site indicate consistently 
good to excellent performances. The^ range, of mean scores is homogeneous 
between 4.68 to 4.97. Results from the Thibodaux, Louisiana, field site 
are, however, in contrast to these results. Teacher trainees in this field 
site performed ^nly at acceptable- gto fair levels. The mean scores on 
different modules range fairly widely from a 2.00 for Desig ning Tut o ri;ig , 
Materials to 3.19 for Classroom graphics for Handica pped Child ren. 

In general, results from the applied performance tests indicate that 
the mean performances of teacher trainees are acceptab le ^.at the least. 
However, there is fairly striking evidence that the modules have produced 
different outcomes in different field sites and are not as consistent as 
earlier formative evaluations and individual tests seemed to indicate. The 
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•Table 5 Results from the Applied Performance Test 



MODULE 


Combined 

• 


Rutland 


3> 

Thibodaux 


r 

M 


SD 


.M SD 




SD 


#' 

Concept Analysis 


4.155 ' 
1 — . — I 


1.130 


'i 4.831 .447 


2.667 


.617 


Task Analysis 


3:940 


1.361 . 


4.758 ..614 


2.353' 


.931 


Planning a Concept Lesson 


4.106 


1.275 ■ 


« 

4.861 ! .340 


2.639 


1.134 


> • ;■ . 
Lesson Planning Jhrough 


*3.796 


■^ 1.379 ^ - 


■4.758 


.614 


1 

2.286 


.717 


TaS^ Analysis' 

Designing Tutoring 
Material^ 


4.114 ' 


L ■ 

lj401 


4.906, ■ 


' .296 


2.000 . 


.853 


Teacher-Made Reading 
Materials, for the 
Handicapped 


4.366 


* 1.11? 


4.906 


.296 


2.444 


.726 


Classroom Graphics for 
•Handicapped Children 


4.336 ' 


T 

( .945 


i 4.788 


.415 


i 

' 3.189 .950 


Classroom Charts for' 
Handicapped Children 


4.039 


t ■ ■ ■ 

1.229 


1 
1 

4.675- 


.451 , 


2.130 


.707 


Instructional Games for 
Handicapped Children 


'f 

1 4.080 


1.307 


. 4.970 


.174. . 


2.353 


.606 
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major discrepancy between the t^wo field sites' ma^ be attributed to one or 
both of the following causes: ^ ' 



1. Instrucytor variable . Although both instruQl^s wer? equally 

enthusiastic aid competent, it is possible that their standards of ^valua- 

' / ^ 

rion differed considerably. Although' the evaluation checklists were / 

criterion-based, there w^s some obvious subjectivity in allocating a suitable- 
number in the various five-point scales. There is some indication from our^ 
inspection of the student products and instructor evaluations that while \ 
there is a high degree of internal consistency within the evaluations of 
each instructor, there is some lack of inter-rater reliability. In general, 
the instructor at Thibodaux, Louisiana, had more^ stringent criteria for her 
ratings. The instructor at Rutland, Vermont, had a slightly "lower*' standard, 
and these standards were consistent with those used in our earlier field 
tests of individual modules, 

> 

2- Trainee , variabiles ,' Although both field sites represented small- 
sized rural teacher-training programs in special education^ it is possible 
that the types of trainees enrolled in the two different courses , dififered 

y 

considea:'^^^.^ Data collected in our telephone conversations:: with the^ 
two instr«Gt(^rs 4^d- suggest th^^^ Trairj^es enrolled in the 

Thibodaux, Louisiana, course were older inservice teachers working for 
required dredits in the evenings. They were unenthus iastic about the course 
in general and toward the competencies in particular, It^is likely that 
this lack of enthusiasm could have contributed to the lower mean scores in 
this field site, * ^ 

In spite of these plausible explanations, the fact remains that in at 
least one fi^ld site, '^he materials failed to produce results consistent with 
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earlier findings during formative evaluation and during *the individual 
module tests. This suggest^the need for a 'careful analysis of the^char- 
acteri^tics of the trainees in the . Ihibodaiix site and the utilization pro- 
cedure in order to improve the instructional and motivational effectiveness 
of the course and the inter-rater relia^lity of the applied performance 
tes ts . ■ ' ^ ■ 

The differences between the two field sites become even more salient 
when the data is presented in the form of percentage charts . Comparative 



'Percentage charts which indicate the percent of teacher trainees scoring 
. above a specific level in the five-point scale are given in Figures 5.2 to 
5.10. 

Cha nges in Attitudes Towar d Preinstructiona l Competencies. All teacher 
trainees were pretested on their attitudes toward the competencies related 
to each module before and after the total\^clcage testing through the use 
of a standardized semantic differential sca^^ containing^l? bi-polar adjec- 
tives. I^esults from these attitude measurements are provided in^nine individual 
charts (Figures 5.11 to 5.19) on the following pages for the combined field 
sites. The discrepancy between the two field sites does not appear to be 
as great in this case as it was in the case of the results from the applied 
performance tests. An analysis of the^harts 'reporting the combined results 

■ s 

does not reveal any clear-cut patterns. However, the following tentative 
conclusions may be reached: /\/ 

1.. In general, teacher trainees appeared to have a fairly positive 

... ^ 

attitude towards "the competencij^s dealt with the individual 
modules. No modjule received a rating below' the 3^ in any of the 
five-point items. Most of the ratings clustered between 4 and 5. 
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MODULE- 



CONCEPT ANALYSIS 



Louisiana, 

Vermont 

C^ombinBcJ 



100 



90 



UJ 

^ 60 
Uj 40 

Z 



10 




\ 



+ 



+ 



+ 



4 



/ 2 3 

TEST SCORES 



Figure 5.2 Comparative Percentage Chart 



TASK ANALYSIS 



Louisiana 

Vermont — — 
C^ombined 




/ 2 3 

TEST SCORES 



Figure 5.3 Comparative Percentage Chart 



MODULE- 



. LESSON PLANNING THROUGH TASK ANALYSIS 



Louisiana IT 

Vermont 

Combined 



/9O 
90 
60 
70 
60 
50 



UJ 40 



K 20 



30 



10 




\ 



TEST SCORES 



Figure 5.4 Comparative Percentage Chart 



IC^Di Jl p: PLANNING A CONCEPT LESSON 



Louisiana ^. 

Vermont 

Combined 



Ul 

Z 



100 
90 
80 
70 
60 
50 
40 

20 
10 




\ 



\ 



\ 



\ 



TEST SCORES 

Figure 5. 5 Comparative Percentage Chart 
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MODULE'' 



INSTRUCTIONAL GAMES FOR HAhJDI CAPPED CHILDREN 



Louisiana 

Vermont J — 
Combined l_ 



100 



90 

ad 

70 
60 
50 



tu 

* UJ 40 



30 
20 
/O 



\ 



\ 



\ 



/ 



\ 



\ 



\ 



+ 



+ 



/ V 2 3 

TEST SCORES 



4 ^ 



Figure 5.6 Comparative Percentage Chart 
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^ ' TEACHER-MADE READING fUlERIALS 

MODULE' I^OR THE HANDICAPPED J 



Louisiana 

Vermont 

Combined 



joo 

90 
60 



Uj 40 

z 

K 20 



60 



50 _» 




\ 



\ 



\ 



\ 



+ 



+ 



+ 



/ 2 3 

TEST SCORES 



Figure 5.7 Compai*ative F^ercentage Chart 
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MODULEi 



CLASSROOM CHARTS FOR KAND I CAPPED CHILDREN 



uana 
Vermont ^ 
Combined 



100 



90 



80 



UJ 40 

z 

K 20 
/O 




\ 



V 



\ 



\ 



+ 



+ 



+ 



; « 2 3 
, TEST SCORES 

Figure 5.8 Comparative Percent^^ge Chart 



/\/[^DiJI^ £.* CLASSROOM GRAPHICS FOR HAND I CAPPED CHILD R'EN 

LoUfsianq «. 

Verfhont ^— 

Combir^jJ' — — - 



/ 



zoo 



90 X 
y> 60 4- 

UJ SO JL 

^ 30 X 
K 20 



/O 




\ 



\ 



\ 



\ 



\ 



\ 



TEST SCORES 



Figure' 5,9 ComparatiVj^PerCentage Chart 
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AAC^Di Jl. F' ' t^ES I GN I N n TUTORINfi ft/^TERlALS 

Louisiana ^ 

Vermont . 

Combined 



100, 



90 



80 



u + 

V-/ 

Uj 40 X 

Z 

^ 30 X 
K 20 



/o 



/ 




\ 



\ 



\ 



\ 



\ 



\ 



\ 



\ 



A 



+- 



+ 



+ 



^ TEST 5COR^S , 

, Figure 5,10 Comparati-^e Percentage Chart 
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FIELD SITE; Combinec 



MODULE^ Conceijt* Analysis 



PRE'TEST MEDIAN:^ _ ^ _ , 
I 2 



POST-TEST f^DlAN: 
3 4 5 



UNPLEASAHT 
USELESS ' 

DULL 

WEAK 

I 

INEFFECTIVE 

UNCLEAR 

IRRELEVANT 

IDEALISTIC 

NOT PERSONALLY 
HELPFUL 

INAPPROPRIATE . 
NOT BENEFICIAL 
TRADITIONAL , 

BORING 
INEFFICIENT 
COSTLY 
VALUELESS 

: . / 



UNIMPQRTANT 




PLEASANT 
USEFUL 
STIMULATING 
POWERFUL 
EFFECTIVE 

RELEVANT 

pkiCTiq^L 

PERSONALLY 
HELPFUL 

APPROPRIATE 

^ BENEFICIAL 

NOVEL 

IMPORTANT 

INTERESTING 

EFFICIENT 

INEXPENSIVE 

VALUABLE 



Fig« 5«11. Attitude Measurement Chart 
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Fin n SITF: Combined 
/ ' MODULE • Analysis, 



PRE'TEST MEDIAN^:^ ' POST-TEST MEDIAN:. 

• I 2 i3t 4 5 
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Rig. 5.12. Attitude Measurement Chart 
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PLEASANT 

USEFUL 

STIMULATING 

POWERFUL 

EFFECTIVE 

CLEAR ij . 
RELEVANT 

PRACTICAL 

PERSONALLY 
HELPFUL 

APPROPRIATE 
BENEFICIAL, 



NOVEL 

'( 

^ IMPORTANT 



INTERESTING 
EFFICIENT 
INEXPENSIVE 
VALUABLE 
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FIELD siTE:_£!!!^l!l!i__ . 

"^v-HIOOULE* Planning Using Task Analysis 



^ P^-TEST MEDiANi 
I 



POST-TEST MEDIAN^. 



UNPLEASANT 
USELESS 

DULL 
WEAK 

JNEFFECmE 

UNCLEAR 

IRRELEVANT 

IDEALISTIC 

NOT PERSONALLY 
HELPFUL 

INAPPROPRIATE 

NOT BENEFICIAL 

TRADITIONAL 

UNIMPORTANT 

BORING 

INEFFICIENT 

COSTLY 

VALUELESS 



\ 



-U- 



pleaSant 

USEFUL 

STIMULATING 

POWERFUL 

EFFECTIVE 

CLEAR 

RELEVANT 

PRACTICAL . 

PERSONALLY 
HELPFUL 

APPROPRIATE 

BENEFICIAL 

NOVEL 



] 



IMPORTANT 

INTERESTING 

EFFICIENT 

INEXPENSIVE 

VALUABLE 



Fig. 5.13; Attitude Measurement Chart 
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FIELD SITE:. 



Combined 



MODULE-' 



Lesson Planning Using Concent Analysis 



PRE'TEsflif€6lAN: 

. I 2 



POST-TE^T MEDIAN'. 
4 5 



UNPLEASANT 
USELESS 

DUL^ 

WEAK 

INEFFECVVE 

UNCLEAR 

IRRELEVANT 

IDEALISTIC 

NOT PERSONALLY 
HELPFUL ^ 

INAPPROPRIATE 



NOT BENEFICIAL 4 



TRADITIONAL 

UNIMPORTANT 

BORING 

INEFFICIENT 

COSTLY 

VALUELESS 




PLEASANT 

USEFUL 

STIMULATING 

POWERFUL 

EFFECTIVE 

CLEAR 

relevant 

practical 
' personaLly 

^^ELPFUL 
APPROPRIATE 
BENEFICIAL 
NOVEL 
IMPORTANT 
INTERESTING 
EFFICIENT 
INEXPENSIVE 
VALUABLE 
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Fig. S.14« Attitude^l&asurement Chart 
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FlEp SITg: Combined 

MODULE * Instructional Games 



PRE-TEST MEDIAN' 



J'OST-TEST MEDtAN'. 

5 




UNPLEASANT 
USELESS 

DULL 

WEAK 

INEFFECTIVE 
UNCLEAR 
IRRELEVANT / 

IDEALISTIC 

NOT PERSONALLY 
HELPFUL 

INAPPROPRIATE 

NOT BENEFICIAL 

TRADITIONAL 

UNIMPORTANT 

BORING 

INEFFICIENT 

COSTLY 

VALUELESS 



Fig. 5.|5. Altitude Measurement Chart 

17.0 



J5 



PLEASANT: 

USEFUL 

STIMULATING 

POWERFUL 

EFFECTIVE 

CLEAR 

RELEVANT ' 

PRACTICAL , 

PERSONALLY 
HELPFUL 

APPROPRIATE^ 

BENEFICIAL 

NOVEL 

IMPORTANT 

iNTERES-aNG 
EFFICIENT 
INEXPENSIVE 
yALl^LE 



) 
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J. 



FIELD SITE:. 



Combined 



MODULE • Teacher -Made Reading Materials 



PRE-TEST MEDIAN:. 



POST-TEST hlEDIAN:- 
4 5 



UNPLEASAHT 
USELESS^ 

/ 

DULL 
WEAK 

INEFFECTIVE 
UNCLEAR 
IRRELEVANT 

f 

\ 

IDEALISTIC 

NOT PERSONALLY 
HELPFUL 

■ -Of 

INAPPROPRIATE 
NOT BENEFICIAL 
TRADITIONAL 
UNIMPORTANT 
BORING ^ 
INEFFICIENT 

COSTLY 
VALUELESS 




PLEASANT 

USEFUL 

STIMULATING 

POWERFUL 

EFFECTIVE 

CLEAR 

RELEVANT 

PRACTICAL 

PERSONALLY 
HELPFUL 

appropriate:, 



BENEFICIAL 
NOVEL , 



IMPORTANT 

INTERESTING 

EFFICIENT 

INEXPENSIVE 

VALUABLE 



/ 
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FIELD SITE: 



. Combined 



MODULE- 



Classroom Charts 



PRE-TEST 



UNPLEASANT 
USELESS 

DULL 

WEAK 



INEFFECTIVE 
UNCLEAR 



IRRELEVANT 

IDEALISTIC 

NOT PERSONALLY 
HELPFUL 

INAPPROPRIATE 

\ 

NOT BENEFltlAL 

\ 

TRADITIONAL 
UNIMPORTANT 
'^BORING , 

Inefficient ^ 



COSTLY 



r 



VALUELESS 



POST-TEST MEDIAN^. 
3 4 5 




Fig, S.l^ Attitucjjp Measurement Chart 



PLEASANT 
USEFUL 
STIMULATING 
POWERFUL 
EFFECTIVE 
CLEAR 
RELEVANT 

PRACTICAL 

PERSONALLY 
HELPFUL 

APPROPRIATE 

BENEFICIAL 

NOVEL ' / 

IMPORTANT 

r 

interesting 
efficient 
inexpensive 
Valuable 
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FIELD SITE:. 



Combined 



MODULE: Classroom Graphics 



PRE-TEST MEDfAN: 
I 



POST-TEST MEDIAN:. 
3 4 5 



UNPLEASANT 
USELESS 
DULL 
WEAK 

INEFFECTIVE 

UNGEAR 

IRRELEVANJ 

IDEALISTIC 

NOT PERSONALLY 
HELPFUL 

INAPPROPRIATE 



NOT BENEFICIAL 4 



TRADITIONAL 



UNIMPORTANT 

BERING 

INEFFIOENT 



COSTLY 
VALUELESS 




PLEASANT 
USEFUL 
STIMULATING [ 
POWERFUL 




RELEVANT 

/ 

PRA(klCAL 

PERSONALLY 
HEllPFUL 

APPROPRIATE 

BENEFICIAL 

NOVEL 

IMPORTANT 

INfllRESTING 

EFFICIENT 

INEXPENSIVE 

VALUABLE 



rig: 5.18. Attitude Measurement Chart 
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FIELD SITF; Combined 



MODULE* '^'J'to^'i^R Materials 



PRE'TEST MEDIAN ' 

i 2 ,3 



POST-TEST MEDIAN'. 
4 5 



UNPUEASANT 
USELESS 
DULL 
WEAK 

INEFFECTIVE 
UNCLEAR 
IRRELEVANT 

IDEALISTIC ^ 

NOT PERSONALLY 
HELPFUL 

* > 

INAPPROPRIATE 
NOT BENEFICJAL 4 
TRADITIONAL 
UNIMPORTANT 
BORING 
INEFFICIENT 
COSTLY 
VAL^LESS 




PLEASANT . 

USEf^fL 

STIMULATING 

POWERFUL 

EFFECTIVE 

CLEAR 

RELEVANT 

PRACTICAL 

PERSONALLY 
HELPFUL 

APPROPRIATE 

aiNEFICIAL 

NOVEL 

IMPORTANT 

INTERESTING 

dPFIciENT , 

IJ^XPENSiyE 



VALUABLE 

■ ■ V 



Fig. 5.19. Attitude Measurement Ch^rt 
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2. Using thd adjective pair^ "p leas ant^iinp leas ant "dull-stimulating" 
and "boring-interesting" as indicative of the affective tone of the various 
preins tructional competencies, it appears that the modules dealing with the 

design of a concrete product (e.g\u tutoring materials^, games ^ and charts) 

were recei-v^jfj^more- positively than those dealing with the underlying com- 

potencies presented in isolation (e.g., concept "analysis, task analysi's, and , 

^ ' . . — \ 

lesson planrfjlng) . , ' 

3. Using the adj^ective pairs "useful-useless," "weak-powerful," 

/ 

"ineffective-effective^." "irrelevant-releVant," ^'not personally helpful- 
personally, helpful," "inajjpropriate-appropriate ," "not beneficial-beneficial," 
"important-i^T^niportafit , " "inef f icient j-efVicient , ". and "value les-s-valuab le" 
as i iJlcative of the teacher trainees' perceptions of the utiAty of a 
specific preinstructional competency, a similar pattern is suggested. The 
skills related to the design of a specific instructional material were 

■ I ^ ^ ... 

perceived to be more\useful than the generalized analytic skills. "\ 

' < . ^ . / • 

4. 'Hie "novel-tradition" dimension consistently received the least 

A » - " ^ ■ 

f 

positive ratings, if novelty is ctinsidered desirable; Most ratings were 
.niidw ay between the poles suggest^U^^ that'the trainees did riot consider the 
donipetencres to be yer>' different from the conventional ones with which 
they were ^^m:y5l,Tar .* ^In aimost aji cases, h\)wever, ,the trainees rated a 
competency 'more, novel after they jriad woiTced through the' module. 

5. , Ratings on the "expensive-inexpensive"f^iHiefi-sion showed considerable^. 
^ ; ' - / ; ^ '\ . 

divergence from ratings on most 'ather dimensions. The trainees changed 



'^tbe-i't ,mind$..t;Qnsiderably as a result of working through the individual 
modules, ^wever, tltere was no. consistent pattern iff these shifts: Jf^ai 



shifted, towaprd either pole/with eq^ual frequ^na^^. 
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Changes i n Attitufes Tbward the Self-Instruc t ional Format . As a part 
of their pre- and posttest sQmantic differential scales, the trainees 
received an additional scale defiling with the general concept of self- 
/'•^instructional -^materials . 'Iliis scale was designed ^to measure changes in the 
trainees' a|;^tud|es " toward t^he ^format o£ the instructional materials ind^ 
pendent of tj)e content .of the individual modules. , f^igure 5.20 graphically 
depicts the trainees' ratings on this semantic di f ferentia^t^s cale before. 

^ ' ' ■ • ^: •■ / 

. and after working through all modules. • >' ^ i 

In general, the trainees' attitudes toward the self -instructional^ 
.^OJpjnat shifted in the positi\yp direction. iJie most notable shift was in 
the dimension of "traditional-novel." The trainees considered the self- 
instructional* format much more nove^l than, they liad before using it. On the 
basis of trainee and instructor comments, this shift reflects' the salience 

^ \ \ ' ' y ^ 

of thq portable teaching machine and the^ mediated 'components. The same 
perceptions^ the basis far a noticeable shift toward the "costlyV pole 



Lon 

I* it 



in anoth* item. ITiere was a slight negative^ shift toward irrelevance , but 



the>dif ference was very i'mall' There was a marked. negative shift toward 
'^"unclear'/ suggesting that the trainees missed the ability of the live ir!- ^r"^ 
x^truct^r^jj^ho would have immediately iclarified their probleitis in a' conven- 



tional course. 
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MODULE • -'^c^f-I"-'^tructjonal Material s 



PRE-TEST MECHAN'^^ — -- 

2 



POST-TEST MEDIAN'. 



UNPLEASANT 
USELESS 

, DULL 

\^EAK 

4 

INEFFECTIVE, 

UNCLEAR 

IRRELEVANT 

IDEALISTIC, ^ 

NOT PERSONALLY 
HELPFUL' 

INAPPROPRrATE 



NOT BENEFICIAL 
TRADITIONAL ■ 



UNIMPORTANT 
BORING 

INEFFICIENT^ 

COSTLY 

VALUELESS 




PLEASANH-y 

USEFUL 

STIMULATING 

POWERFUL 

EFFECTIVE 

CLEAR , 

RELEV/^T 

PRACTIC/\L 

PERSONALLY 
HELPFUL 

APPROPRIATE 

BEI^JEFICIAL 

NOVEL 

IMPORTANT 

INTERESTING 

EFFICIENT 

INEXPENSiyE 

VALUABLE 



Fig. S.20. ^Attitude Measurement Chart 
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. „ . SUMMARY . ■ A: ' ■ 

The total package testing of the preinstructional competencies progl^mL— ^ 
involved testing the trainees' attainment of the s'pecific behavioral objec- 
tives , 'their changes in attitude toward the use ^of each competency and to- 



"yard the self-instructional mode of learning. Trainees* performances^ on 
individual applied test* were evaluated by the instructors at the two field 
^tes . When instruct^ ratings ,,were compared, a major discrepancy was found 
between the perforfnance of -the trainees^.in Id sites ,- Trainees in 

Rutland, Vermont , performed at the .4-r5 le^el (good to exceptional) while 
trainees in Thibpdaux, Louisiana, perfonned at the 2-3 level (adequate to 
acceptable). Explanations' fior this discrepancy include the unreliability 
of the scoring system as v^ell as differences between the Xvjo instructors 
and the "two g:;oups of trainees, TJiere is a strong indication that tl;ie 
materials are not as self-contained as Tthe earlier formative evaluations 
seemed to suggest, Resulx^ from the attitude measurement were more con- 
sistent betwelen' :the two -sit'^s land they app'eared to be generally positive^ 
Modules ' dealing, with the desigti of a concrete product wer^e generall^v p^^— . . 

& : ^- . . .V r . ■■ ^ ^ ^ ^ ^ ^ 

ceived to be more interesting, ^d useful than those dealing with tFle Lmder- 
.... .J • . ' . y 

lying theory. Trainees attitude toward self- instructeLon jshowed a^^^general 



positive shift, tiowever, the modules were considered^t*)^^^fre less, clear than 
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